00000001:02000400:2.0F:1788463013.407681:0:2951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788463022.427044:0:3154:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788463024.236553:0:3214:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 449 MB/s 00000001:01000000:2.0:1788463024.487259:0:3214:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 605 MB/s 00000001:01000000:1.0:1788463024.740455:0:3214:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2177 MB/s 00000020:02000000:1.0:1788463026.284445:0:3245:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_gbb63b80 00000400:02000000:1.0:1788463028.141548:0:3260:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.111@tcp [8/256/0/180] 00008000:02000000:2.0:1788463033.128527:0:3410:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1788463088.113219:0:5215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788463099.652376:0:5798:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788463099.652381:0:5798:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788463099.652534:0:5798:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f45f746c 00000080:02000400:3.0:1788463099.652547:0:5798:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788463099.658401:0:5798:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788463099.658419:0:5798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788463099.658475:0:5798:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000081b8e265) 00000020:00000080:3.0:1788463099.658500:0:5798:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788463099.676440:0:5798:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788463099.677027:0:5798:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788463099.701222:0:5798:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788463099.701269:0:5798:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788463099.701292:0:5798:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788463099.701348:0:5798:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788463099.701380:0:5798:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788463099.701833:0:5798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788463099.701842:0:5798:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788463099.701855:0:5798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee3564e 00000020:01000004:2.0:1788463099.701863:0:5798:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788463099.701867:0:5798:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788463099.701871:0:5798:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f45f746c from MGS 00000020:01000004:2.0:1788463099.701876:0:5798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788463099.701897:0:5798:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000000fdf2b8f) 00000020:00000080:2.0:1788463099.701910:0:5798:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788463099.702029:0:5798:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f45f746c from MGS, refs=2 00080000:01000000:2.0:1788463099.702035:0:5798:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788463099.702040:0:5798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee3565c 00000100:00100000:2.0:1788463099.702143:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788463099.702272:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788463099.702278:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0F:1788463099.702928:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788463099.702939:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788463099.703628:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463099.706670:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788463099.707020:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788463099.708187:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788463099.708199:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788463099.708669:0:5798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788463099.708675:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788463099.709917:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463099.709920:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463099.709922:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463099.710274:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463099.710277:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463099.710279:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463099.710860:0:5798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788463099.715777:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788463099.959727:0:5798:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4767 MB/s 00000001:01000000:3.0:1788463100.209858:0:5798:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5155 MB/s 00000001:01000000:2.0:1788463100.463452:0:5798:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 426 MB/s 00000001:01000000:0.0:1788463100.712744:0:5798:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 743 MB/s 00080000:10000000:0.0:1788463100.726594:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788463100.746134:0:5798:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788463100.746153:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788463100.746156:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788463100.746807:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788463100.746871:0:5798:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788463100.746909:0:5798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788463100.747081:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788463100.747108:0:5798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788463100.747486:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463100.747645:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788463100.747651:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788463100.750269:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788463100.750281:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788463100.750932:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788463100.750939:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788463100.752992:0:5798:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788463100.753021:0:5798:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.111@tcp' 00000020:01000004:3.0:1788463100.753023:0:5798:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788463100.754311:0:5798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.111@tcp (typ=mgc) 00000020:00000080:3.0:1788463100.754328:0:5798:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.111@tcp (000000008b8b3ffd) 00000020:00000080:3.0:1788463100.754352:0:5798:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788463100.754479:0:5798:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000095799944@MGC192.168.204.111@tcp: add connection 192.168.204.111@tcp at head 00010000:00010000:3.0:1788463100.754652:0:5798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.111@tcp-0 is initialized 00000040:01000000:3.0:1788463100.754659:0:5798:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788463100.755024:0:5812:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788463100.760885:0:5813:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788463100.761045:0:5798:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.111@tcp (uuid 777dc377-0af3-4f9e-a02c-a691119a7ded) 00000020:00000080:3.0:1788463100.761086:0:5798:0:(genops.c:1385:class_connect()) connect: client 777dc377-0af3-4f9e-a02c-a691119a7ded, cookie 0xc3fe72277ee3566a 00000100:00080000:3.0:1788463100.761102:0:5798:0:(import.c:545:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463100.761107:0:5798:0:(import.c:665:import_select_connection()) MGC192.168.204.111@tcp: import 0000000095799944 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1788463100.761151:0:5798:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000095d7a9fa x1875339408048256/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463100.761377:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095d7a9fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:777dc377-0af3-4f9e-a02c-a691119a7ded:3275:1875339408048256:0@lo:250: 00000100:00100000:0.0:1788463100.761513:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463100.761784:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408048256 00000100:00100000:2.0:1788463100.762901:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408048256 00000100:00100000:2.0:1788463100.762963:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463100.762972:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000422e7d44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3275:x1875339408048256:12345-0@lo:250: 00010000:00080000:2.0:1788463100.763001:0:5809:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 777dc377-0af3-4f9e-a02c-a691119a7ded@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:2.0:1788463100.763036:0:5809:0:(genops.c:1385:class_connect()) connect: client 777dc377-0af3-4f9e-a02c-a691119a7ded, cookie 0xc3fe72277ee35671 00000100:00080000:2.0:1788463100.763200:0:5809:0:(import.c:65:import_set_state_nolock()) 00000000afd1bbb6 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788463100.763330:0:5798:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 777dc377-0af3-4f9e-a02c-a691119a7ded->MGS 00000020:01000004:3.0:1788463100.763354:0:5798:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788463100.763397:0:5798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788463100.763412:0:5798:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000df798f0a) 00000020:00000080:3.0:1788463100.763424:0:5798:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788463100.768162:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000422e7d44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+5:3275:x1875339408048256:12345-0@lo:250: Request processed in 5180us (6639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463100.768195:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463100.770927:0:3275:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788463100.770948:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.111@tcp: connect to target with instance 0 00000100:00080000:0.0:1788463100.770957:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788463100.770964:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788463100.770968:0:3275:0:(import.c:65:import_set_state_nolock()) 0000000095799944 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788463100.770973:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788463100.771881:0:3275:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788463100.771893:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095d7a9fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:777dc377-0af3-4f9e-a02c-a691119a7ded:3275:1875339408048256:0@lo:250: 00010000:00010000:3.0:1788463100.773102:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463100.784140:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463100.785883:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788463100.785891:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788463100.787663:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463100.787755:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788463100.789382:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788463100.789397:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788463100.793635:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463100.798269:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788463100.798279:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788463100.799457:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788463100.799466:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788463100.859553:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463100.859804:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788463100.859811:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788463100.860942:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788463100.860950:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788463100.861552:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463100.861727:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788463100.861731:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788463100.862589:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788463100.862596:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788463100.863665:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463100.865263:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788463100.865272:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788463100.866018:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788463100.866026:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788463100.873341:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463100.873576:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788463100.873581:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788463100.875643:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788463100.875656:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788463100.918444:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463100.919734:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463100.919745:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788463100.921881:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788463100.921896:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788463100.927537:0:5798:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788463100.927561:0:5798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788463100.932846:0:5798:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788463100.932886:0:5798:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788463100.932895:0:5798:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788463100.933083:0:5798:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788463100.933123:0:5798:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.111@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788463100.933127:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788463100.933128:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788463100.933129:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463100.933130:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463100.933132:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463100.933133:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463100.933134:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463100.933136:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788463100.933137:0:5798:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788463100.933139:0:5798:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788463100.933140:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463100.933142:0:5798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788463100.933144:0:5798:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788463100.933146:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788463100.933148:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788463100.933149:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463100.933150:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463100.933151:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463100.933152:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463100.933153:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463100.933159:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788463100.933160:0:5798:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788463100.933161:0:5798:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788463100.933162:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463100.933162:0:5798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788463100.933284:0:5798:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788463100.933302:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408048384:0@lo:253: 00000100:00100000:1.0:1788463100.933389:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463100.933494:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 000000006f4a7359 going to sleep for 11 seconds 00000100:00100000:2.0:1788463100.938532:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408048384 00000100:00100000:2.0:1788463100.938554:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408048384 00000100:00100000:2.0:1788463100.938671:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463100.938680:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d256ca56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+5:5798:x1875339408048384:12345-0@lo:253: 20000000:01000000:2.0:1788463100.938754:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788463100.938758:0:5811:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788463100.939305:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788463100.939384:0:5811:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788463100.939740:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463100.940782:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788463100.945715:0:5811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788463100.945737:0:5811:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788463100.945744:0:5811:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788463100.945748:0:5811:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788463100.945766:0:5811:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788463100.946082:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463100.946334:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788463100.946348:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788463100.946404:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788463100.946459:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788463100.946495:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788463100.946581:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788463100.946588:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788463100.946624:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788463100.946631:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788463100.946656:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788463100.946662:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788463100.946728:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788463100.946772:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788463100.946801:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788463100.946806:0:5811:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788463100.946819:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463100.947041:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788463100.947050:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788463100.947082:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788463100.947115:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788463100.947161:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788463100.947173:0:5811:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788463100.947258:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788463100.947267:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788463100.947311:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788463100.947348:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788463100.947379:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788463100.947395:0:5811:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788463100.947496:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788463100.947505:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788463100.947534:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788463100.947562:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788463100.947763:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788463100.947809:0:5811:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788463100.947819:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788463100.949508:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788463100.950009:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788463100.950036:0:5811:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.111@tcp for mdt 20000000:01000000:2.0:1788463100.950038:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.111@tcp (null) (null) (null) 00000040:00080000:2.0:1788463100.950066:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788463100.950072:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788463100.950100:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788463100.950107:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.111@tcp (null) (null) 00000040:00080000:2.0:1788463100.950422:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788463100.950443:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788463100.950478:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788463100.950506:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788463100.950577:0:5811:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788463100.950581:0:5811:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788463100.950585:0:5811:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788463100.950597:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788463100.950600:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788463100.950629:0:5811:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788463100.950631:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788463100.951597:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788463100.953074:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788463100.953125:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788463100.953391:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788463100.953405:0:5811:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788463100.953408:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788463100.954010:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788463100.954458:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788463100.954495:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788463100.954563:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1788463100.954575:0:5811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788463100.954577:0:5811:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788463100.954582:0:5811:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788463100.954585:0:5811:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788463100.954590:0:5811:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788463100.954596:0:5811:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788463100.955395:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788463100.955533:0:5811:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788463100.969429:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788463100.969509:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788463100.970170:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788463100.970205:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788463100.970300:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463100.970319:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463100.970330:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463100.970335:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463100.970342:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463100.970349:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463100.970368:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007096534a already unused, calling callback (00000000ca60eabb) 00010000:00010000:2.0:1788463100.970373:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463100.970381:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463100.970397:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463100.970404:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463100.970410:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007096534a/0xc3fe72277ee3567f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788463100.970427:0:5811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788463101.203366:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d256ca56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+5:5798:x1875339408048384:12345-0@lo:253: Request processed in 264679us (269969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463101.203389:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463101.203486:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408048384:0@lo:253: 10000000:01000000:1.0:1788463101.203506:0:5798:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788463101.203509:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788463101.203511:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788463101.203513:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463101.203514:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788463101.203516:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463101.203517:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463101.203518:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463101.203520:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788463101.203521:0:5798:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788463101.203522:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463101.203523:0:5798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788463101.203541:0:5798:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f45f746c from lustre-MDT0000 10000000:01000000:1.0:1788463101.203569:0:5798:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788463101.203572:0:5798:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788463101.203575:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ba5c7d7cd40 10000000:01000000:1.0:1788463101.203580:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463101.203588:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ba5c7d7cd40 from 1 10000000:01000000:1.0:1788463101.203591:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788463101.203635:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.203647:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.203680:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463101.203763:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408048512:0@lo:101: 00000100:00100000:1.0:1788463101.203866:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463101.203985:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a65ce5b9 going to sleep for 11 seconds 00000100:00100000:2.0:1788463101.204057:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408048512 00000100:00100000:2.0:1788463101.204064:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408048512 00000100:00100000:2.0:1788463101.204105:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463101.204113:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3f558f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+5:5798:x1875339408048512:12345-0@lo:101: 00010000:00010000:2.0:1788463101.204124:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463101.204136:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007096534a/0xc3fe72277ee3568d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35686 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.204160:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007096534a/0xc3fe72277ee3568d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35686 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.204171:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007096534a/0xc3fe72277ee3568d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35686 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.204188:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007096534a, rc 0) 00000100:00100000:2.0:1788463101.204231:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3f558f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+6:5798:x1875339408048512:12345-0@lo:101: Request processed in 120us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463101.204238:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463101.204342:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408048512:0@lo:101: 00010000:00010000:1.0:1788463101.204355:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.204363:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463101.204414:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408048640:0@lo:501: 00000100:00100000:1.0:1788463101.204448:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463101.204459:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a65ce5b9 going to sleep for 11 seconds 00000100:00100000:0.0:1788463101.204506:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408048640 00000100:00100000:0.0:1788463101.204510:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408048640 00000100:00100000:0.0:1788463101.204580:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463101.204587:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c9838e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+6:5798:x1875339408048640:12345-0@lo:501: 00000100:00100000:0.0:1788463101.204868:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c9838e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+6:5798:x1875339408048640:12345-0@lo:501: Request processed in 281us (418us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788463101.204875:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463101.204937:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408048640:0@lo:501: 10000000:01000000:1.0:1788463101.204965:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788463101.204984:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.204992:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463101.205002:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ba5c88d5800 10000000:01000000:1.0:1788463101.205006:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788463101.205015:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ba5c88d5800 10000000:01000000:1.0:1788463101.205018:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788463101.205021:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ba5c88d5800 from 1 10000000:01000000:1.0:1788463101.205023:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788463101.205041:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 00000000305b7326/0xc3fe72277ee35694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.205047:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: 00000000305b7326/0xc3fe72277ee35694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.205055:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 00000000305b7326/0xc3fe72277ee35694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463101.205065:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408048768:0@lo:101: 00000100:00100000:1.0:1788463101.205090:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463101.205324:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a65ce5b9 going to sleep for 11 seconds 00000100:00100000:2.0:1788463101.205408:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408048768 00000100:00100000:2.0:1788463101.205414:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408048768 00000100:00100000:2.0:1788463101.205445:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463101.205451:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c3489ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+6:5798:x1875339408048768:12345-0@lo:101: 00010000:00010000:2.0:1788463101.205459:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463101.205470:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079e0720e/0xc3fe72277ee3569b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35694 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.205488:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079e0720e/0xc3fe72277ee3569b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35694 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.205497:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079e0720e/0xc3fe72277ee3569b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35694 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.205504:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079e0720e, rc 0) 00000100:00100000:2.0:1788463101.205538:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c3489ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+7:5798:x1875339408048768:12345-0@lo:101: Request processed in 88us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463101.205543:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463101.205608:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408048768:0@lo:101: 00010000:00010000:1.0:1788463101.205617:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: 00000000305b7326/0xc3fe72277ee35694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.205625:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: 00000000305b7326/0xc3fe72277ee35694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463101.205636:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788463101.205649:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: 00000000305b7326/0xc3fe72277ee35694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.205656:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: 00000000305b7326/0xc3fe72277ee35694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463101.205673:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788463101.205676:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463101.205680:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ba5c88d5800 10000000:01000000:1.0:1788463101.205700:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788463101.205703:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788463101.205705:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788463101.205719:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.205725:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.205731:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463101.205741:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408048896:0@lo:101: 00000100:00100000:1.0:1788463101.205764:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463101.205775:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a65ce5b9 going to sleep for 11 seconds 00000100:00100000:0.0:1788463101.205896:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408048896 00000100:00100000:0.0:1788463101.205901:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408048896 00000100:00100000:0.0:1788463101.205920:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463101.205925:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db10b982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+7:5798:x1875339408048896:12345-0@lo:101: 00010000:00010000:0.0:1788463101.205932:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463101.205941:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca06d691/0xc3fe72277ee356a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee356a2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463101.205953:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca06d691/0xc3fe72277ee356a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee356a2 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463101.205961:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca06d691/0xc3fe72277ee356a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee356a2 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463101.205967:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca06d691, rc 0) 00000100:00100000:0.0:1788463101.205991:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db10b982 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+8:5798:x1875339408048896:12345-0@lo:101: Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463101.205996:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463101.206103:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408048896:0@lo:101: 00010000:00010000:1.0:1788463101.206113:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.206119:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463101.206160:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049024:0@lo:501: 00000100:00100000:1.0:1788463101.206182:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463101.206213:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a65ce5b9 going to sleep for 11 seconds 00000100:00100000:0.0:1788463101.206263:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408049024 00000100:00100000:0.0:1788463101.206267:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408049024 00000100:00100000:0.0:1788463101.206292:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463101.206297:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c2dd78a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+8:5798:x1875339408049024:12345-0@lo:501: 00000100:00100000:0.0:1788463101.206518:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c2dd78a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+9:5798:x1875339408049024:12345-0@lo:501: Request processed in 220us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463101.206525:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463101.206644:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049024:0@lo:501: 00000100:00100000:1.0:1788463101.206670:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049152:0@lo:503: 00000100:00100000:1.0:1788463101.206734:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463101.206748:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a65ce5b9 going to sleep for 11 seconds 00000100:00100000:0.0:1788463101.206860:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408049152 00000100:00100000:0.0:1788463101.206864:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408049152 00000100:00100000:0.0:1788463101.206892:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463101.206898:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8c8cd2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+9:5798:x1875339408049152:12345-0@lo:503: 00000100:00100000:0.0:1788463101.207084:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8c8cd2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+9:5798:x1875339408049152:12345-0@lo:503: Request processed in 186us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463101.207090:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463101.207364:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049152:0@lo:503: 00000100:00100000:2.0:1788463101.207944:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e1dbd37 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:5840:1875339408049280:0@lo:502: 00000100:00100000:2.0:1788463101.207986:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463101.208052:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 0000000081d09219 going to sleep for 11 seconds 00000100:00100000:0.0:1788463101.208086:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408049280 00000100:00100000:0.0:1788463101.208091:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408049280 00000100:00100000:0.0:1788463101.208154:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788463101.208161:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044713037 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+9:5840:x1875339408049280:12345-0@lo:502: 00000100:00100000:0.0:1788463101.208327:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044713037 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+9:5840:x1875339408049280:12345-0@lo:502: Request processed in 167us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463101.208334:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463101.208398:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e1dbd37 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:5840:1875339408049280:0@lo:502: 00000020:01000000:3.0:1788463101.208423:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463101.208444:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463101.208447:0:5840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788463101.208452:0:5840:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788463101.208455:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463101.208471:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000da5359a9) 00000020:00000080:3.0:1788463101.208488:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788463101.208495:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788463101.208574:0:5840:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788463101.208581:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee356b7 00000020:00000080:3.0:1788463101.208854:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788463101.208859:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463101.208863:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463101.208864:0:5840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788463101.208867:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463101.208870:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463101.208871:0:5840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788463101.208875:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463101.208888:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000024f97c9a) 00000020:00000080:3.0:1788463101.208898:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788463101.208903:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788463101.208910:0:5840:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788463101.208913:0:5840:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788463101.208919:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788463101.208961:0:5840:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f45f746c from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788463101.208973:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000cfa98c54) 00000020:00000080:3.0:1788463101.208980:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788463101.209034:0:5840:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788463101.209039:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3fe72277ee356cc 00000020:00000080:3.0:1788463101.209124:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788463101.209130:0:5840:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788463101.209134:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc3fe72277ee356d3 00080000:01000000:3.0:1788463101.209138:0:5840:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788463101.209141:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee356da 00080000:10000000:3.0:1788463101.209506:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788463101.209678:0:5840:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788463101.213474:0:5840:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788463101.270302:0:5840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788463101.271178:0:5840:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788463101.273419:0:5840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788463101.273908:0:5840:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788463101.302504:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000be78a329) 00000020:00000080:3.0:1788463101.302529:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788463101.302609:0:5840:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788463101.302616:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee356e8 00000020:00000080:3.0:1788463101.303245:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788463101.304997:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463101.339292:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788463101.433389:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788463101.473944:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463101.529722:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463101.571115:0:5840:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788463101.680663:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc3fe72277ee356ef 00000020:00000080:0.0:1788463101.681504:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788463101.681518:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463101.681525:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463101.681527:0:5840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788463101.681530:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463101.681535:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463101.681537:0:5840:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463101.681540:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463101.681541:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788463101.681544:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463101.681547:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463101.681548:0:5840:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788463101.681550:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463101.681555:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463101.681556:0:5840:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788463101.681560:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788463101.681611:0:5840:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788463101.681717:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a8a31c1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:5840:1875339408049408:0@lo:502: 00000100:00100000:0.0:1788463101.681952:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463101.682079:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2d8e1a6 going to sleep for 11 seconds 00000100:00100000:3.0:1788463101.682984:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408049408 00000100:00100000:3.0:1788463101.683001:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408049408 00000100:00100000:3.0:1788463101.683128:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463101.683149:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bac313f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+9:5840:x1875339408049408:12345-0@lo:502: 00000100:00100000:3.0:1788463101.683780:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bac313f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+9:5840:x1875339408049408:12345-0@lo:502: Request processed in 624us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463101.683789:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788463101.684043:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a8a31c1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:5840:1875339408049408:0@lo:502: 00000020:01000000:0.0:1788463101.684091:0:5840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463101.684100:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463101.684103:0:5840:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788463101.684107:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788463101.684840:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788463101.684883:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788463101.684910:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.684924:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463101.684934:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ba5c88d5800 from 1 10000000:01000000:1.0:1788463101.684938:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788463101.684989:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.684998:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.685011:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463101.685036:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049536:0@lo:101: 00000100:00100000:1.0:1788463101.685101:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463101.686434:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408049536 00000100:00100000:2.0:1788463101.686451:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408049536 00000100:00100000:2.0:1788463101.686511:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788463101.686520:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024586231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+9:5798:x1875339408049536:12345-0@lo:101: 00010000:00010000:2.0:1788463101.686542:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463101.686561:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ffcef12e/0xc3fe72277ee356fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee356f6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.686594:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ffcef12e/0xc3fe72277ee356fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee356f6 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.686607:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ffcef12e/0xc3fe72277ee356fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee356f6 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.686619:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ffcef12e, rc 0) 00000100:00100000:2.0:1788463101.686680:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024586231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+10:5798:x1875339408049536:12345-0@lo:101: Request processed in 163us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463101.686731:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463101.687345:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 0000000096c62d44 going to sleep for 11 seconds 00000100:00100000:1.0:1788463101.687376:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049536:0@lo:101: 00010000:00010000:1.0:1788463101.687413:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.687434:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463101.688452:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049664:0@lo:256: 00000100:00100000:1.0:1788463101.688558:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463101.688714:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 0000000096c62d44 going to sleep for 11 seconds 00000100:00100000:3.0:1788463101.688824:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408049664 00000100:00100000:3.0:1788463101.688838:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408049664 00000100:00100000:0.0:1788463101.689146:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788463101.689159:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000200007fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+10:5798:x1875339408049664:12345-0@lo:256: 20000000:01000000:0.0:1788463101.689199:0:5811:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788463101.689206:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788463101.689286:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000200007fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+10:5798:x1875339408049664:12345-0@lo:256: Request processed in 130us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463101.689293:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788463101.689949:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060287dc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049664:0@lo:256: 10000000:01000000:0.0:1788463101.691104:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788463101.691369:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463101.691384:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463101.691395:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c88d5800 from 1 10000000:01000000:0.0:1788463101.691397:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788463101.691463:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463101.691489:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463101.691500:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463101.691524:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a8a31c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049792:0@lo:101: 00000100:00100000:0.0:1788463101.691600:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463101.692067:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eab73a1b going to sleep for 11 seconds 00000100:00100000:3.0:1788463101.692393:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408049792 00000100:00100000:3.0:1788463101.692406:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408049792 00000100:00100000:3.0:1788463101.692520:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463101.692531:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062262fa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+10:5798:x1875339408049792:12345-0@lo:101: 00010000:00010000:3.0:1788463101.692549:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463101.692572:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a4c2ec72/0xc3fe72277ee3570b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35704 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463101.692604:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4c2ec72/0xc3fe72277ee3570b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35704 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463101.692615:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a4c2ec72/0xc3fe72277ee3570b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35704 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463101.692624:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a4c2ec72, rc 0) 00000100:00100000:3.0:1788463101.692718:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062262fa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5798:x1875339408049792:12345-0@lo:101: Request processed in 189us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463101.692726:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463101.693051:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a8a31c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049792:0@lo:101: 00010000:00010000:0.0:1788463101.693070:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463101.693081:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463101.693172:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a8a31c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049920:0@lo:501: 00000100:00100000:0.0:1788463101.693222:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463101.693526:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eab73a1b going to sleep for 11 seconds 00000100:00100000:2.0:1788463101.693613:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408049920 00000100:00100000:2.0:1788463101.693620:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408049920 00000100:00100000:2.0:1788463101.693651:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788463101.693659:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093269739 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5798:x1875339408049920:12345-0@lo:501: 00000100:00100000:2.0:1788463101.695003:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093269739 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5798:x1875339408049920:12345-0@lo:501: Request processed in 1342us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463101.695015:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463101.695356:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a8a31c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408049920:0@lo:501: 00000100:00100000:0.0:1788463101.695410:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a8a31c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408050048:0@lo:503: 00000100:00100000:0.0:1788463101.695472:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463101.695510:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eab73a1b going to sleep for 11 seconds 00000100:00100000:3.0:1788463101.695575:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408050048 00000100:00100000:3.0:1788463101.695582:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408050048 00000100:00100000:3.0:1788463101.695625:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463101.695633:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b66250e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5798:x1875339408050048:12345-0@lo:503: 00000040:00080000:3.0:1788463101.695712:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788463101.695964:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a8a31c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408050048:0@lo:503: 00000100:00100000:3.0:1788463101.696389:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b66250e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5798:x1875339408050048:12345-0@lo:503: Request processed in 136us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463101.696399:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:0.0:1788463101.697435:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788463101.697670:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788463101.697725:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463101.697754:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.697924:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463101.697991:0:5798:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788463101.697994:0:5798:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ba5c88d5800 10000000:01000000:2.0:1788463101.697997:0:5798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ba5c88d5800 10000000:01000000:2.0:1788463101.698001:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463101.698007:0:5798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba5c88d5800 from 1 10000000:01000000:2.0:1788463101.698010:0:5798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463101.698060:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.698068:0:5798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.698082:0:5798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463101.698112:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408050176:0@lo:101: 00000100:00100000:2.0:1788463101.698483:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463101.698577:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f7eb75e going to sleep for 11 seconds 00000100:00100000:0.0:1788463101.698664:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408050176 00000100:00100000:0.0:1788463101.698674:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408050176 00000100:00100000:0.0:1788463101.699310:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788463101.699320:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f042d5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5798:x1875339408050176:12345-0@lo:101: 00010000:00010000:0.0:1788463101.699340:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463101.699359:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee35719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35712 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463101.699396:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee35719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35712 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463101.699408:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee35719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35712 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463101.699427:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f8ad3a97, rc 0) 00000100:00100000:0.0:1788463101.699503:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f042d5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5798:x1875339408050176:12345-0@lo:101: Request processed in 185us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463101.699510:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463101.699602:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408050176:0@lo:101: 00010000:00010000:2.0:1788463101.699623:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.699633:0:5798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463101.699761:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408050304:0@lo:501: 00000100:00100000:2.0:1788463101.699950:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463101.700087:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f7eb75e going to sleep for 11 seconds 00000100:00100000:3.0:1788463101.700197:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408050304 00000100:00100000:3.0:1788463101.700204:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408050304 00000100:00100000:3.0:1788463101.700235:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788463101.700241:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cd3e74d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5798:x1875339408050304:12345-0@lo:501: 00000100:00100000:3.0:1788463101.700568:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cd3e74d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5798:x1875339408050304:12345-0@lo:501: Request processed in 326us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463101.700576:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463101.700761:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408050304:0@lo:501: 00000100:00100000:2.0:1788463101.700814:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408050432:0@lo:503: 00000100:00100000:2.0:1788463101.700855:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463101.700882:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 000000009f7eb75e going to sleep for 11 seconds 00000100:00100000:3.0:1788463101.701053:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408050432 00000100:00100000:3.0:1788463101.701058:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408050432 00000100:00100000:3.0:1788463101.701079:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463101.701085:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c0818d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5798:x1875339408050432:12345-0@lo:503: 00000100:00100000:3.0:1788463101.701460:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c0818d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5798:x1875339408050432:12345-0@lo:503: Request processed in 375us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463101.701468:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788463101.701618:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408050432:0@lo:503: 00000100:00100000:2.0:1788463101.702127:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:5845:1875339408050560:0@lo:502: 00000100:00100000:2.0:1788463101.702179:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463101.702218:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d42bb20 going to sleep for 11 seconds 00000100:00100000:3.0:1788463101.702308:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408050560 00000100:00100000:3.0:1788463101.702314:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408050560 00000100:00100000:3.0:1788463101.702343:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788463101.702352:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051a5dd9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5845:x1875339408050560:12345-0@lo:502: 00000100:00100000:3.0:1788463101.702616:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051a5dd9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5845:x1875339408050560:12345-0@lo:502: Request processed in 264us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463101.702622:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788463101.702723:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:5845:1875339408050560:0@lo:502: 00000020:01000004:2.0:1788463101.702946:0:5845:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788463101.702968:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006582fcc1) 00000020:00000080:2.0:1788463101.702991:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788463101.703095:0:5845:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f45f746c from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788463101.703101:0:5845:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f45f746c from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788463101.703104:0:5845:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f45f746c 4 00010000:00080000:2.0:1788463101.703221:0:5845:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008cf4400c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:3.0:1788463101.707204:0:5845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788463101.707510:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788463101.707559:0:5845:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788463101.707574:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc3fe72277ee35727 00000100:00080000:3.0:1788463101.707590:0:5845:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788463101.707596:0:5845:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008cf4400c using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1788463101.707636:0:5845:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d44d27cc x1875339408050688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788463101.707662:0:5845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788463101.708075:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d44d27cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875339408050688:0@lo:38: 00000100:00100000:0.0:1788463101.708243:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463101.708473:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c76cbee0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:5845:1875339408050816:0@lo:502: 00000100:00100000:1.0:1788463101.708532:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463101.708563:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408050816 00000100:00100000:1.0:1788463101.708573:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408050816 00000100:00100000:1.0:1788463101.708634:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788463101.708645:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041a83f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5845:x1875339408050816:12345-0@lo:502: 00000100:00100000:1.0:1788463101.709093:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041a83f35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5845:x1875339408050816:12345-0@lo:502: Request processed in 450us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463101.709102:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788463101.709270:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408050688 00000100:00100000:3.0:1788463101.709276:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408050688 00000100:00100000:3.0:1788463101.709309:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463101.709313:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a8a31c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875339408050688:12345-0@lo:38: 00000100:00100000:3.0:1788463101.709369:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a8a31c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875339408050688:12345-0@lo:38: Request processed in 55us (1127us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788463101.709375:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463101.709457:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 0000000096c62d44 going to sleep for 11 seconds 00000100:00100000:1.0:1788463101.709489:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c76cbee0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:5845:1875339408050816:0@lo:502: 00000040:00080000:1.0:1788463101.709527:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1788463101.709796:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463101.709803:0:3275:0:(import.c:65:import_set_state_nolock()) 000000008cf4400c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463101.709807:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788463101.709810:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d44d27cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875339408050688:0@lo:38: 00000020:01000000:3.0:1788463101.710033:0:5798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788463101.710055:0:5798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788463101.710076:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463101.710088:0:5798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788463101.710203:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788463101.710206:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788463101.710208:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463101.710209:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463101.710210:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463101.710211:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463101.710212:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788463101.710214:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788463101.710215:0:5798:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463101.710216:0:5798:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463101.710218:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463101.710220:0:5798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788463101.710231:0:5798:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788463101.710233:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788463101.710234:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788463101.710235:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463101.710236:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463101.710237:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463101.710238:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463101.710239:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788463101.710239:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788463101.710240:0:5798:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463101.710241:0:5798:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463101.710241:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463101.710242:0:5798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788463101.710261:0:5798:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788463101.710274:0:5798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000985ea51a pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408050944:0@lo:253: 00000100:00100000:3.0:1788463101.710314:0:5798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463101.712211:0:5798:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee6f75b2 going to sleep for 11 seconds 00000100:00100000:1.0:1788463101.712509:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408050944 00000100:00100000:1.0:1788463101.712521:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408050944 00000100:00100000:1.0:1788463101.712585:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463101.712593:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b918f89c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5798:x1875339408050944:12345-0@lo:253: 20000000:01000000:1.0:1788463101.712627:0:5811:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788463101.712643:0:5811:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1788463101.801669:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788463101.834716:0:5811:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788463101.834751:0:5811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788463101.834899:0:5832:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788463101.834905:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788463101.834941:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.834990:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ffcef12e/0xc3fe72277ee356fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee356f6 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.834999:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.835045:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ffcef12e/0xc3fe72277ee356fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee356f6 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.835060:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ffcef12e/0xc3fe72277ee356fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee356f6 expref: 12 pid: 5810 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463101.835076:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c76cbee0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1875339408051072:0@lo:104: 00000100:00100000:1.0:1788463101.835154:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463101.835258:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set 00000000118191f1 going to sleep for 11 seconds 00000100:00100000:2.0:1788463101.835639:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408051072 00000100:00100000:2.0:1788463101.835649:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408051072 00000100:00100000:2.0:1788463101.835880:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463101.835902:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000906c75c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5832:x1875339408051072:12345-0@lo:104: 00010000:00010000:2.0:1788463101.835947:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.836062:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788463101.836069:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000906c75c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5832:x1875339408051072:12345-0@lo:104: Request processed in 171us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463101.836077:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788463101.836104:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463101.836109:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.836116:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007ad58578 already unused, calling callback (0000000036d6dc11) 10000000:00010000:2.0:1788463101.836120:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.836140:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463101.836148:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463101.836154:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463101.836254:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.836261:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463101.836283:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.836289:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: 000000007ad58578/0xc3fe72277ee356f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee356fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.836320:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463101.836322:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463101.836323:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463101.836398:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408051200:0@lo:103: 00000100:00100000:2.0:1788463101.836463:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463101.836577:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408051200 00000100:00100000:2.0:1788463101.836595:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408051200 00010000:00010000:2.0:1788463101.836625:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ffcef12e/0xc3fe72277ee356fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee356f6 expref: 13 pid: 5810 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463101.836682:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463101.836745:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017730967 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:3277:x1875339408051200:12345-0@lo:103: 00010000:00010000:2.0:1788463101.836758:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463101.836762:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ffcef12e/0xc3fe72277ee356fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee356f6 expref: 13 pid: 5810 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463101.837108:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c76cbee0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1875339408051072:0@lo:104: 00010000:00010000:1.0:1788463101.837143:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838694:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ffcef12e/0xc3fe72277ee356fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee356f6 expref: 13 pid: 5810 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838718:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ffcef12e/0xc3fe72277ee356fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee356f6 expref: 13 pid: 5810 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838737:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838746:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788463101.838830:0:5802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003925033s 00010000:00010000:2.0:1788463101.838851:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838858:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838927:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838934:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838940:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e0f18bd already unused, calling callback (00000000ca60eabb) 00010000:00010000:2.0:1788463101.838945:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838954:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838974:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463101.838987:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463101.839090:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017730967 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:3277:x1875339408051200:12345-0@lo:103: Request processed in 2344us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463101.839102:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463101.839456:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408051200:0@lo:103: 00010000:00010000:1.0:1788463101.840003:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.840014:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463101.840020:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e0f18bd/0xc3fe72277ee3572e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463101.854818:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b918f89c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5798:x1875339408050944:12345-0@lo:253: Request processed in 142218us (144496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463101.854865:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788463101.855292:0:5798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000985ea51a pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:5798:1875339408050944:0@lo:253: 10000000:01000000:2.0:1788463101.855311:0:5798:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788463101.855314:0:5798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463101.855322:0:5798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788463101.855323:0:5798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463101.855324:0:5798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463101.855326:0:5798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463101.855327:0:5798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463101.855328:0:5798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788463101.855330:0:5798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788463101.855331:0:5798:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788463101.855332:0:5798:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788463101.855334:0:5798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463101.855335:0:5798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788463101.855352:0:5798:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788463101.865070:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788463101.866114:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788463101.866481:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788463101.866659:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788463101.867054:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788463101.867297:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788463101.869659:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788463101.870318:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788463101.870577:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788463101.870932:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788463101.871126:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788463101.871392:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788463101.923183:0:5798:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788463102.001255:0:5798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788463102.001457:0:5850:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788463102.001461:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788463102.001755:0:5851:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788463102.011811:0:5798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788463102.012141:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788463102.012634:0:5798:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788463102.012642:0:5798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788463102.012798:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463102.014605:0:5798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788463102.015184:0:5798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788463102.015220:0:5798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788463102.015537:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788463102.015791:0:5798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788463102.018726:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788463102.018900:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788463102.019115:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788463102.019262:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788463102.019478:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788463102.019780:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788463102.019947:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788463102.020136:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788463102.020331:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788463102.020474:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788463102.020663:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788463102.022395:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788463102.022635:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788463102.022944:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788463102.023087:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788463102.023238:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788463102.023533:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788463102.023662:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788463102.024076:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788463102.024269:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788463102.024516:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788463102.024733:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788463102.025019:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788463102.025157:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788463102.025319:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788463102.025478:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788463102.025962:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788463102.026139:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788463102.026313:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788463102.026475:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788463102.026635:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788463102.027060:0:5798:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788463102.027313:0:5798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788463102.089026:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788463102.230923:0:5798:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788463102.230965:0:5798:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbaac01cbb988 00100000:10000000:0.0:1788463102.230974:0:5798:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788463102.235668:0:5798:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788463102.235755:0:5798:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788463102.235789:0:5798:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788463102.235855:0:5798:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788463102.290735:0:5851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788463102.290815:0:5851:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788463102.290820:0:5851:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788463102.822677:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463103.845059:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463104.870778:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463105.893854:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463106.919716:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463107.113159:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788463107.113170:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788463107.113173:0:37:0:(import.c:65:import_set_state_nolock()) 000000008cf4400c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463107.113187:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008cf4400c using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463107.113207:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002001031f x1875339408051456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463107.113311:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002001031f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875339408051456:0@lo:38: 00000100:00100000:0.0:1788463107.113391:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463107.113476:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408051456 00000100:00100000:0.0:1788463107.113483:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408051456 00000100:00100000:0.0:1788463107.113518:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463107.113525:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aff27ccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3275:x1875339408051456:12345-0@lo:38: 00010000:00080000:0.0:1788463107.113552:0:5818:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:0.0:1788463107.113588:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc3fe72277ee35735 00000004:00100000:0.0:1788463107.113645:0:5818:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788463107.113795:0:5818:0:(import.c:65:import_set_state_nolock()) 00000000b7125ccc : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463107.113842:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aff27ccf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875339408051456:12345-0@lo:38: Request processed in 317us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463107.113850:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788463107.113890:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002001031f x1875339408051456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463107.113903:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788463107.113910:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788463107.113914:0:3275:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788463107.113916:0:3275:0:(import.c:65:import_set_state_nolock()) 000000008cf4400c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463107.113920:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002001031f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875339408051456:0@lo:38: 00000100:00100000:1.0:1788463107.114426:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053eaaadd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408051328:0@lo:400: 00000100:00100000:1.0:1788463107.114464:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463107.118436:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408051328 00000100:00100000:0.0:1788463107.118458:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408051328 00000100:00100000:0.0:1788463107.118544:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463107.118554:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f91e7437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:3278:x1875339408051328:12345-0@lo:400: 00000100:00100000:0.0:1788463107.118704:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f91e7437 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:3278:x1875339408051328:12345-0@lo:400: Request processed in 129us (4217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463107.118714:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463107.118878:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053eaaadd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408051328:0@lo:400: 00000001:02000400:3.0:1788463107.439483:0:6093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788463107.941126:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463108.965465:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788463109.668803:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788463109.668811:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ba5c88d5800 from 3 10000000:01000000:0.0:1788463109.668834:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788463109.668883:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 00000000b67c7895/0xc3fe72277ee3573c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463109.668896:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: 00000000b67c7895/0xc3fe72277ee3573c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463109.668907:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 00000000b67c7895/0xc3fe72277ee3573c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463109.668934:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002001031f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408051584:0@lo:101: 00000100:00100000:0.0:1788463109.669018:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463109.669094:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000477be7e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788463109.669327:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408051584 00000100:00100000:1.0:1788463109.669337:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408051584 00000100:00100000:1.0:1788463109.669397:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463109.669406:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3fc19ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5813:x1875339408051584:12345-0@lo:101: 00010000:00010000:1.0:1788463109.669421:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463109.669437:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ad58578/0xc3fe72277ee35743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee3573c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463109.669460:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ad58578/0xc3fe72277ee35743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee3573c expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463109.669470:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ad58578/0xc3fe72277ee35743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3573c expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463109.669479:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ad58578, rc 0) 00000100:00100000:1.0:1788463109.669528:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3fc19ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5813:x1875339408051584:12345-0@lo:101: Request processed in 123us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463109.669534:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463109.669739:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002001031f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408051584:0@lo:101: 00010000:00010000:2.0:1788463109.669758:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: 00000000b67c7895/0xc3fe72277ee3573c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463109.669768:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: 00000000b67c7895/0xc3fe72277ee3573c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463109.669832:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408051712:0@lo:256: 00000100:00100000:2.0:1788463109.669868:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463109.669900:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db89e45a going to sleep for 11 seconds 00000100:00100000:1.0:1788463109.671586:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408051712 00000100:00100000:1.0:1788463109.671601:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408051712 00000100:00100000:1.0:1788463109.671675:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463109.671714:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000502dfbcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5813:x1875339408051712:12345-0@lo:256: 20000000:01000000:1.0:1788463109.671742:0:5809:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788463109.671764:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788463109.671767:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788463109.671882:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000502dfbcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5813:x1875339408051712:12345-0@lo:256: Request processed in 200us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463109.671889:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788463109.672050:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f351c0e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408051712:0@lo:256: 10000000:01000000:2.0:1788463109.672101:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788463109.672109:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: 00000000b67c7895/0xc3fe72277ee3573c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463109.672126:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: 00000000b67c7895/0xc3fe72277ee3573c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463109.988882:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463111.014731:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463112.052499:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463112.229810:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463112.229846:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bbca5e11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408051840:0@lo:400: 00000100:00100000:3.0:1788463112.229933:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463112.230421:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408051840 00000100:00100000:0.0:1788463112.230436:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408051840 00000100:00100000:0.0:1788463112.230507:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788463112.230519:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ff59bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+12:3278:x1875339408051840:12345-0@lo:400: 00000100:00100000:0.0:1788463112.230630:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ff59bc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+12:3278:x1875339408051840:12345-0@lo:400: Request processed in 114us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463112.230639:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788463112.230722:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bbca5e11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408051840:0@lo:400: 00000100:00100000:2.0:1788463112.230983:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a257680a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408051968:0@lo:400: 00000100:00100000:2.0:1788463112.231038:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463112.232528:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408051968 00000100:00100000:0.0:1788463112.232540:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408051968 00000100:00100000:0.0:1788463112.232589:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463112.232599:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f351c0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408051968:12345-0@lo:400: 00000100:00100000:0.0:1788463112.232680:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f351c0e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408051968:12345-0@lo:400: Request processed in 83us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463112.232706:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788463112.232972:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a257680a x1875339408051968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463112.232988:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a257680a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408051968:0@lo:400: 00000020:00000080:2.0:1788463112.572553:0:6296:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff424017f0 20000000:00000080:2.0:1788463112.572591:0:6296:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ba5fff10800 uarg=0000000000000000 20000000:01000000:2.0:1788463112.572646:0:6296:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788463112.572660:0:6296:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788463112.572666:0:6296:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788463112.573475:0:6296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788463112.573489:0:6296:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788463112.578330:0:6296:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463112.579327:0:6296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788463112.579415:0:6296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788463112.579476:0:6296:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788463112.579499:0:6296:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788463112.579524:0:6296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463112.579549:0:6296:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a4c2ec72/0xc3fe72277ee3570b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35704 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463112.579571:0:6296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463112.579622:0:6296:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a4c2ec72/0xc3fe72277ee3570b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35704 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463112.579659:0:6296:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a4c2ec72/0xc3fe72277ee3570b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35704 expref: 11 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463112.579674:0:6296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094e54848 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6296:1875339408052096:0@lo:104: 00000100:00100000:2.0:1788463112.579784:0:6296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463112.579852:0:6296:0:(client.c:2716:ptlrpc_set_wait()) set 000000006cd390a5 going to sleep for 11 seconds 00000100:00100000:0.0:1788463112.580485:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408052096 00000100:00100000:0.0:1788463112.580495:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408052096 00000100:00100000:0.0:1788463112.580556:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463112.580564:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b78da1f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+3:6296:x1875339408052096:12345-0@lo:104: 00010000:00010000:0.0:1788463112.580579:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463112.580662:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463112.580667:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b78da1f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+3:6296:x1875339408052096:12345-0@lo:104: Request processed in 104us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463112.580673:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788463112.580712:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463112.580717:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463112.580725:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f77983ec already unused, calling callback (0000000036d6dc11) 10000000:00010000:0.0:1788463112.580728:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463112.580736:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463112.580742:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463112.580748:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463112.580785:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463112.580791:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463112.580819:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463112.580825:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: 00000000f77983ec/0xc3fe72277ee35704 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee3570b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463112.580841:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463112.580843:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463112.580845:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463112.580866:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4924284 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408052224:0@lo:103: 00000100:00100000:0.0:1788463112.581241:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463112.581326:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408052224 00000100:00100000:3.0:1788463112.581331:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408052224 00010000:00010000:3.0:1788463112.581354:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a4c2ec72/0xc3fe72277ee3570b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35704 expref: 12 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463112.581392:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463112.581399:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000998e731a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:3277:x1875339408052224:12345-0@lo:103: 00010000:00010000:3.0:1788463112.581411:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463112.581414:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a4c2ec72/0xc3fe72277ee3570b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35704 expref: 12 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581424:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a4c2ec72/0xc3fe72277ee3570b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35704 expref: 12 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581446:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581455:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581472:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581480:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581488:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581495:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581501:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003b8d70fb already unused, calling callback (00000000ca60eabb) 00010000:00010000:3.0:1788463112.581506:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581521:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581531:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463112.581541:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463112.581580:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000998e731a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:3277:x1875339408052224:12345-0@lo:103: Request processed in 182us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463112.581588:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788463112.581743:0:6296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a4c2ec72/0xc3fe72277ee3570b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35704 expref: 11 pid: 5809 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463112.581756:0:6296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094e54848 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6296:1875339408052096:0@lo:104: 00010000:00010000:2.0:1788463112.581778:0:6296:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463112.581787:0:6296:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463112.581791:0:6296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463112.581796:0:6296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003b8d70fb/0xc3fe72277ee3574a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463112.582007:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4924284 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408052224:0@lo:103: 00010000:00010000:2.0:1788463113.065847:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463114.085248:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463115.112313:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463116.141767:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463117.159847:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463117.350982:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094e54848 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408052352:0@lo:400: 00000100:00100000:0.0:1788463117.351103:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463117.351334:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408052352 00000100:00100000:1.0:1788463117.351342:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408052352 00000100:00100000:1.0:1788463117.351401:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463117.351410:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ae87b4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+11:3278:x1875339408052352:12345-0@lo:400: 00000100:00100000:3.0:1788463117.353240:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d00bfded pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408052480:0@lo:400: 00000100:00100000:3.0:1788463117.353626:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463117.353722:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408052480 00000100:00100000:3.0:1788463117.353730:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408052480 00000100:00100000:3.0:1788463117.353784:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463117.353793:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064d74aa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408052480:12345-0@lo:400: 00000100:00100000:3.0:1788463117.353872:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064d74aa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408052480:12345-0@lo:400: Request processed in 80us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463117.353880:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788463117.354598:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d00bfded x1875339408052480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463117.354614:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d00bfded pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408052480:0@lo:400: 00000100:00100000:1.0:1788463117.359401:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ae87b4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+11:3278:x1875339408052352:12345-0@lo:400: Request processed in 7980us (8287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463117.359402:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094e54848 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408052352:0@lo:400: 00000100:00100000:1.0:1788463117.359430:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788463118.182921:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463119.207729:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788463119.270281:0:6663:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788463119.270287:0:6663:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788463119.270502:0:6663:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000016880843 00000020:01000004:1.0:1788463119.270525:0:6663:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788463119.270540:0:6663:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788463119.270565:0:6663:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000a33706e1) 00000020:00000080:1.0:1788463119.270580:0:6663:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788463119.286987:0:6663:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788463119.287586:0:6663:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788463119.310905:0:6663:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788463119.330043:0:6663:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788463119.330108:0:6663:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788463119.330181:0:6663:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788463119.330236:0:6663:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788463119.331286:0:6663:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788463119.331301:0:6663:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788463119.331318:0:6663:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3fe72277ee35758 00000020:01000004:3.0:1788463119.331328:0:6663:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788463119.331360:0:6663:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788463119.331364:0:6663:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788463119.331371:0:6663:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788463119.331375:0:6663:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788463119.331389:0:6663:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000091ed1af6) 00000020:00000080:3.0:1788463119.331402:0:6663:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788463119.334315:0:6663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463119.335290:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788463119.335298:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788463119.340662:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463119.340679:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788463119.341328:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788463119.341338:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788463119.344577:0:6663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463119.344808:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788463119.344824:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788463119.349851:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788463119.349876:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788463119.378854:0:6663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463119.379223:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788463119.379232:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788463119.381629:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463119.381644:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788463119.382573:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788463119.382583:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788463119.388788:0:6663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463119.389042:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788463119.389049:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788463119.392012:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788463119.392030:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788463119.464660:0:6663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463119.466149:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788463119.466163:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788463119.468506:0:6663:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788463119.468521:0:6663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788463119.469314:0:6663:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788463119.469343:0:6663:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788463119.469350:0:6663:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788463119.491545:0:6663:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788463119.491588:0:6663:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.111@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788463119.491592:0:6663:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788463119.491597:0:6663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788463119.491598:0:6663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463119.491599:0:6663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463119.491600:0:6663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463119.491601:0:6663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463119.491602:0:6663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463119.491604:0:6663:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463119.491605:0:6663:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463119.491606:0:6663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463119.491608:0:6663:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788463119.491708:0:6663:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788463119.491711:0:6663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788463119.491713:0:6663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788463119.491713:0:6663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463119.491714:0:6663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463119.491715:0:6663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463119.491716:0:6663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463119.491717:0:6663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463119.491718:0:6663:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463119.491719:0:6663:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463119.491720:0:6663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463119.491721:0:6663:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788463119.491760:0:6663:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788463119.491778:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8c4928b pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408052608:0@lo:253: 00000100:00100000:3.0:1788463119.492136:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.492306:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f0610d1f going to sleep for 11 seconds 00000100:00100000:1.0:1788463119.492418:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408052608 00000100:00100000:1.0:1788463119.492427:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408052608 00000100:00100000:1.0:1788463119.492521:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788463119.492530:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5a40abb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+11:6663:x1875339408052608:12345-0@lo:253: 20000000:01000000:1.0:1788463119.492569:0:5809:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788463119.492574:0:5809:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788463119.492579:0:5809:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788463119.492583:0:5809:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788463119.494547:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463119.495220:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788463119.495238:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788463119.495281:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788463119.495290:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788463119.495317:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788463119.495385:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788463119.496532:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788463119.496560:0:5809:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.111@tcp 20000000:01000000:1.0:1788463119.496563:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.111@tcp (null) (null) (null) 00000040:00080000:1.0:1788463119.496600:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788463119.496709:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788463119.496802:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788463119.496813:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.111@tcp (null) (null) 00000040:00080000:1.0:1788463119.497191:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788463119.497203:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788463119.497236:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788463119.497295:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788463119.499257:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788463119.499291:0:5809:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.111@tcp 20000000:01000000:0.0:1788463119.499293:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.111@tcp (null) (null) (null) 00000040:00080000:0.0:1788463119.499333:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788463119.499341:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788463119.499372:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788463119.499379:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.111@tcp (null) (null) 00000040:00080000:0.0:1788463119.499439:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788463119.499450:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788463119.499505:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788463119.499545:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788463119.499564:0:5809:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788463119.499568:0:5809:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788463119.499575:0:5809:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788463119.499576:0:5809:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788463119.499580:0:5809:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788463119.499594:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788463119.499596:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788463119.500027:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788463119.500031:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788463119.500770:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788463119.501337:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788463119.501386:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788463119.501460:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788463119.501474:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788463119.501476:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463119.503250:0:6679:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463119.503348:0:6679:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463119.503402:0:6679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788463119.503864:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788463119.504227:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788463119.504266:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788463119.504281:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788463119.504283:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463119.505289:0:6680:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463119.505355:0:6680:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463119.505400:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788463119.506117:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788463119.506178:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788463119.506496:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:1.0:1788463119.506523:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788463119.506545:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.506564:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007096534a/0xc3fe72277ee3568d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35686 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.506571:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ca06d691/0xc3fe72277ee356a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee356a2 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.506578:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee35719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35712 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.506584:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.506813:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee35719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35712 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.507027:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee35719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35712 expref: 11 pid: 5810 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463119.507123:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c76cbee0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5809:1875339408052736:0@lo:104: 00000100:00100000:1.0:1788463119.507200:0:5809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463119.507387:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ca06d691/0xc3fe72277ee356a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee356a2 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.507396:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ca06d691/0xc3fe72277ee356a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee356a2 expref: 11 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463119.507404:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000983c3917 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5809:1875339408052864:0@lo:104: 00000100:00100000:1.0:1788463119.507428:0:5809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463119.507539:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007096534a/0xc3fe72277ee3568d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35686 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.507548:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007096534a/0xc3fe72277ee3568d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35686 expref: 11 pid: 5810 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463119.507556:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000292bde5c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5809:1875339408052992:0@lo:104: 00000100:00100000:1.0:1788463119.507577:0:5809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463119.507587:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a97d5a86 going to sleep for 11 seconds 00000100:00100000:0.0:1788463119.507737:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408052736 00000100:00100000:0.0:1788463119.507745:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408052736 00000100:00100000:0.0:1788463119.507792:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408052864 00000100:00100000:0.0:1788463119.507796:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408052864 00000100:00100000:0.0:1788463119.507808:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408052992 00000100:00100000:0.0:1788463119.507810:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408052992 00000100:00100000:0.0:1788463119.508017:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463119.508027:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dddc85b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+5:5809:x1875339408052736:12345-0@lo:104: 00000100:00100000:3.0:1788463119.508141:0:5800:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788463119.508151:0:5800:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788463119.508405:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.508567:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463119.508580:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dddc85b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+5:5809:x1875339408052736:12345-0@lo:104: Request processed in 556us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.508588:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463119.508618:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463119.508627:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cfa1b57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+4:5809:x1875339408052864:12345-0@lo:104: 00010000:00010000:0.0:1788463119.508636:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.508672:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788463119.508677:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cfa1b57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+4:5809:x1875339408052864:12345-0@lo:104: Request processed in 52us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.508712:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463119.508726:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463119.508731:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bfe488a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5809:x1875339408052992:12345-0@lo:104: 00010000:00010000:0.0:1788463119.508739:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.508767:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788463119.508772:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bfe488a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5809:x1875339408052992:12345-0@lo:104: Request processed in 41us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.508777:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788463119.508917:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788463119.508924:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.508946:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000555d6eb already unused, calling callback (0000000036d6dc11) 10000000:00010000:3.0:1788463119.508950:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.508958:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463119.508964:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463119.508970:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463119.509000:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509007:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463119.509022:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509029:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee35712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35719 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509053:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463119.509056:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509062:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000093dc49db already unused, calling callback (0000000036d6dc11) 10000000:00010000:3.0:1788463119.509064:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509090:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463119.509096:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463119.509101:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463119.509114:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509120:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463119.509124:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509130:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: 0000000093dc49db/0xc3fe72277ee356a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee356a9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509139:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463119.509141:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509146:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d442c478 already unused, calling callback (0000000036d6dc11) 10000000:00010000:3.0:1788463119.509148:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509153:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463119.509158:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463119.509168:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463119.509179:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509185:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463119.509198:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509204:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: 00000000d442c478/0xc3fe72277ee35686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee3568d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.509217:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463119.509219:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463119.509220:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463119.509227:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463119.509238:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a22ead51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408053376:0@lo:103: 00000100:00100000:3.0:1788463119.509275:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463119.509421:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788463119.509830:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788463119.509835:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba5c88d5800 from 21 10000000:01000000:0.0:1788463119.509839:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463119.509863:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.509871:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.509889:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463119.509904:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4924284 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408053504:0@lo:101: 00000100:00100000:0.0:1788463119.509951:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.509985:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ae88af3 going to sleep for 11 seconds 00000100:00100000:0.0:1788463119.510002:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d7d0026 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408053120:0@lo:103: 00000100:00100000:0.0:1788463119.510026:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.510057:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463119.510063:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a141e72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408053248:0@lo:103: 00000100:00100000:0.0:1788463119.510095:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.510146:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408053376 00000100:00100000:0.0:1788463119.510154:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408053376 00010000:00010000:0.0:1788463119.510183:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007096534a/0xc3fe72277ee3568d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35686 expref: 12 pid: 5810 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463119.510203:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408053120 00000100:00100000:0.0:1788463119.510206:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408053120 00000100:00100000:1.0:1788463119.510212:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c76cbee0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5809:1875339408052736:0@lo:104: 00000100:00100000:1.0:1788463119.510225:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000983c3917 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5809:1875339408052864:0@lo:104: 00010000:00010000:0.0:1788463119.510232:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee35719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35712 expref: 13 pid: 5810 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463119.510235:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000292bde5c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5809:1875339408052992:0@lo:104: 00000100:00100000:0.0:1788463119.510248:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408053248 00000100:00100000:0.0:1788463119.510252:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408053248 00010000:00010000:0.0:1788463119.510264:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ca06d691/0xc3fe72277ee356a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee356a2 expref: 14 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463119.510279:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788463119.510287:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463119.510287:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000411af932 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:3279:x1875339408053376:12345-0@lo:103: 00010000:00010000:0.0:1788463119.510308:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463119.510316:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007096534a/0xc3fe72277ee3568d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35686 expref: 14 pid: 5810 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510327:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007096534a/0xc3fe72277ee3568d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35686 expref: 14 pid: 5810 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510342:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007096534a/0xc3fe72277ee3568d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35686 expref: 14 pid: 5810 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510357:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463119.510401:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000411af932 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:3279:x1875339408053376:12345-0@lo:103: Request processed in 116us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.510407:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463119.510421:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463119.510427:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000673addc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+12:3276:x1875339408053120:12345-0@lo:103: 00010000:00010000:0.0:1788463119.510435:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463119.510437:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee35719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35712 expref: 12 pid: 5810 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510445:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee35719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35712 expref: 12 pid: 5810 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510454:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee35719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35712 expref: 12 pid: 5810 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510463:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463119.510487:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000673addc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:3276:x1875339408053120:12345-0@lo:103: Request processed in 61us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.510493:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463119.510511:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463119.510516:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e53f9f96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+10:3276:x1875339408053248:12345-0@lo:103: 00010000:00010000:0.0:1788463119.510524:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463119.510528:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ca06d691/0xc3fe72277ee356a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee356a2 expref: 10 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510536:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ca06d691/0xc3fe72277ee356a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee356a2 expref: 10 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510547:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ca06d691/0xc3fe72277ee356a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee356a2 expref: 10 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463119.510557:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a22ead51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408053376:0@lo:103: 00010000:00010000:0.0:1788463119.510558:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510571:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510583:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510590:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510596:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510602:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.510608:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d832a63d already unused, calling callback (00000000ca60eabb) 00000100:00100000:2.0:1788463119.510888:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408053504 00000100:00100000:2.0:1788463119.510894:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408053504 00000100:00100000:2.0:1788463119.510925:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463119.510932:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d454c9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+10:5813:x1875339408053504:12345-0@lo:101: 00010000:00010000:2.0:1788463119.510943:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463119.510954:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000057261e2a/0xc3fe72277ee35774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee3576d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.510970:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.510978:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000057261e2a/0xc3fe72277ee35774 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.510992:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.511000:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 7/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.511032:0:5811:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000057261e2a/0xc3fe72277ee35774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50080000000000 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.511046:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057261e2a/0xc3fe72277ee35774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50080000000000 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.511068:0:5811:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: 0000000057261e2a/0xc3fe72277ee35774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.511215:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcad9f5c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408053632:0@lo:105: 00000100:00100000:2.0:1788463119.511249:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.511276:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1a01a9f going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.511294:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408053632 00000100:00100000:2.0:1788463119.511298:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408053632 00000100:00100000:2.0:1788463119.511326:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463119.511333:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf2300a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5811:x1875339408053632:12345-0@lo:105: 00010000:00010000:2.0:1788463119.511341:0:5800:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.511349:0:5800:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.511356:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.511362:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.511368:0:5800:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.511384:0:5800:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock 000000006ce5a5e8) 00000100:00100000:2.0:1788463119.511415:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf2300a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5811:x1875339408053632:12345-0@lo:105: Request processed in 84us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.511422:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463119.511447:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcad9f5c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408053632:0@lo:105: 00010000:00010000:2.0:1788463119.511463:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000057261e2a/0xc3fe72277ee35774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.511469:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000057261e2a, rc 0) 00000100:00100000:2.0:1788463119.511499:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d454c9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5813:x1875339408053504:12345-0@lo:101: Request processed in 568us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.511504:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463119.511536:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4924284 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408053504:0@lo:101: 00010000:00010000:2.0:1788463119.511548:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.511599:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dcad9f5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408053760:0@lo:501: 00010000:00010000:1.0:1788463119.511721:0:5809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.511730:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788463119.511740:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788463119.514881:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.514926:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1a01a9f going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.514954:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408053760 00000100:00100000:2.0:1788463119.514965:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408053760 00000100:00100000:2.0:1788463119.515019:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788463119.515030:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000120c0d08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5813:x1875339408053760:12345-0@lo:501: 00010000:00010000:0.0:1788463119.515240:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.515261:0:5803:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:0.0:1788463119.515263:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.515273:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d832a63d/0xc3fe72277ee35766 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.515297:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463119.515361:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d7d0026 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408053120:0@lo:103: 00000100:00100000:0.0:1788463119.515422:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e53f9f96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:3276:x1875339408053248:12345-0@lo:103: Request processed in 4906us (5327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.515431:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463119.515458:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a141e72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408053248:0@lo:103: 00000100:00100000:2.0:1788463119.516259:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000120c0d08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+10:5813:x1875339408053760:12345-0@lo:501: Request processed in 1229us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.516279:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463119.516380:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dcad9f5c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408053760:0@lo:501: 00000100:00100000:0.0:1788463119.516430:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065b557e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408053888:0@lo:503: 00000100:00100000:0.0:1788463119.516475:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.516507:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006bd619f going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.516553:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408053888 00000100:00100000:2.0:1788463119.516559:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408053888 00000100:00100000:2.0:1788463119.517471:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463119.517484:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000063311f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+10:5813:x1875339408053888:12345-0@lo:503: 00000100:00100000:0.0:1788463119.522211:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000063311f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+10:5813:x1875339408053888:12345-0@lo:503: Request processed in 4724us (5729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.522226:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463119.525536:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065b557e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408053888:0@lo:503: 00000100:00100000:0.0:1788463119.526631:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065b557e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6683:1875339408054016:0@lo:502: 00000100:00100000:0.0:1788463119.526743:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.526801:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e59ed182 going to sleep for 11 seconds 00000100:00100000:1.0:1788463119.526974:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408054016 00000100:00100000:1.0:1788463119.526984:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408054016 00000100:00100000:1.0:1788463119.527035:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788463119.527053:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029440d3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+10:6683:x1875339408054016:12345-0@lo:502: 00000100:00100000:1.0:1788463119.527342:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029440d3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+10:6683:x1875339408054016:12345-0@lo:502: Request processed in 289us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.527351:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463119.527583:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065b557e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6683:1875339408054016:0@lo:502: 00000100:00100000:0.0:1788463119.527662:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065b557e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6683:1875339408054144:0@lo:502: 00000100:00100000:0.0:1788463119.527741:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.527763:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e59ed182 going to sleep for 11 seconds 00000100:00100000:1.0:1788463119.527938:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408054144 00000100:00100000:1.0:1788463119.527944:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408054144 00000100:00100000:1.0:1788463119.527977:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788463119.527984:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dab526d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+10:6683:x1875339408054144:12345-0@lo:502: 00000100:00100000:1.0:1788463119.528164:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dab526d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+10:6683:x1875339408054144:12345-0@lo:502: Request processed in 181us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.528172:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463119.528445:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065b557e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6683:1875339408054144:0@lo:502: 00000040:00080000:0.0:1788463119.528467:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788463119.528640:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788463119.528664:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788463119.528673:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.528713:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: 000000006ce5a5e8/0xc3fe72277ee3576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463119.528724:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788463119.528727:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788463119.528730:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788463119.528758:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 000000005b253e34/0xc3fe72277ee3577b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.528766:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: 000000005b253e34/0xc3fe72277ee3577b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.528775:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 000000005b253e34/0xc3fe72277ee3577b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.528790:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc3682b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408054272:0@lo:101: 00000100:00100000:2.0:1788463119.528840:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.528868:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcf4e224 going to sleep for 11 seconds 00000100:00100000:0.0:1788463119.529153:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408054272 00000100:00100000:0.0:1788463119.529159:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408054272 00000100:00100000:0.0:1788463119.529201:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463119.529209:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc2c853d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+10:5813:x1875339408054272:12345-0@lo:101: 00010000:00010000:0.0:1788463119.529220:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463119.529233:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca06d691/0xc3fe72277ee35782 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee3577b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.529255:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca06d691/0xc3fe72277ee35782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee3577b expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.529265:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca06d691/0xc3fe72277ee35782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3577b expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.529273:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca06d691, rc 0) 00000100:00100000:0.0:1788463119.529308:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc2c853d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5813:x1875339408054272:12345-0@lo:101: Request processed in 101us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.529315:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788463119.529437:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc3682b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408054272:0@lo:101: 00010000:00010000:2.0:1788463119.529458:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: 000000005b253e34/0xc3fe72277ee3577b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.529466:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: 000000005b253e34/0xc3fe72277ee3577b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.529511:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc3682b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408054400:0@lo:501: 00000100:00100000:2.0:1788463119.529537:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.529563:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcf4e224 going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.529576:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408054400 00000100:00100000:2.0:1788463119.529580:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408054400 00000100:00100000:2.0:1788463119.529597:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788463119.529602:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a719c9c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5813:x1875339408054400:12345-0@lo:501: 00000100:00100000:2.0:1788463119.530341:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a719c9c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5813:x1875339408054400:12345-0@lo:501: Request processed in 735us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.530350:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463119.532439:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc3682b2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408054400:0@lo:501: 00000100:00100000:0.0:1788463119.532510:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065b557e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408054528:0@lo:503: 00000100:00100000:0.0:1788463119.532587:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.532867:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c42b20c6 going to sleep for 11 seconds 00000100:00100000:1.0:1788463119.533168:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408054528 00000100:00100000:1.0:1788463119.533176:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408054528 00000100:00100000:1.0:1788463119.533265:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788463119.533273:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2dd9b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5813:x1875339408054528:12345-0@lo:503: 00000100:00100000:1.0:1788463119.533492:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2dd9b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5813:x1875339408054528:12345-0@lo:503: Request processed in 220us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.533501:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463119.533578:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065b557e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408054528:0@lo:503: 00000100:00100000:3.0:1788463119.537853:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001dc3fdb8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6684:1875339408054656:0@lo:502: 00000100:00100000:3.0:1788463119.538401:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.538507:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set 0000000026fb8fcb going to sleep for 11 seconds 00000100:00100000:1.0:1788463119.538592:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408054656 00000100:00100000:1.0:1788463119.538602:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408054656 00000100:00100000:1.0:1788463119.538837:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788463119.538845:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eab70660 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:6684:x1875339408054656:12345-0@lo:502: 00000100:00100000:1.0:1788463119.539444:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eab70660 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:6684:x1875339408054656:12345-0@lo:502: Request processed in 598us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.539455:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788463119.539802:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001dc3fdb8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6684:1875339408054656:0@lo:502: 00000020:01000000:3.0:1788463119.539839:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788463119.539848:0:6684:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788463119.539855:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463119.539858:0:6684:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788463119.539865:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788463119.539869:0:6684:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:3.0:1788463119.539894:0:6684:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788463119.539903:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463119.539935:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (000000003ce20412) 00000020:00000080:3.0:1788463119.539959:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:3.0:1788463119.539966:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788463119.540067:0:6684:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788463119.540082:0:6684:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788463119.540092:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee35790 00010000:00080000:3.0:1788463119.540120:0:6684:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000189065b6@lustre-OST0000-osc-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:3.0:1788463119.540366:0:6684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788463119.635021:0:6684:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788463119.635059:0:6684:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788463119.637018:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463119.637349:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463119.637402:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788463119.637500:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788463119.640538:0:6685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463119.640553:0:6685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788463119.642201:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788463119.642216:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788463119.642262:0:6684:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788463119.642285:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3fe72277ee35797 00000100:00080000:0.0:1788463119.642297:0:6684:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463119.642304:0:6684:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000189065b6 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463119.642341:0:6684:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000065b557e1 x1875339408054784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463119.642363:0:6684:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788463119.642441:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ad27b66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408054912:0@lo:400: 00000020:01000000:0.0:1788463119.642501:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463119.642506:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463119.642509:0:6684:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788463119.642512:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463119.642517:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463119.642521:0:6684:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000100:00100000:2.0:1788463119.642524:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788463119.642526:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463119.642529:0:6684:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788463119.642552:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000314c404a pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6684:1875339408055040:0@lo:502: 00000100:00100000:0.0:1788463119.642614:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463119.642647:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408055040 00000100:00100000:1.0:1788463119.642656:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408055040 00000100:00100000:1.0:1788463119.642710:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788463119.642717:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a87b6324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:6684:x1875339408055040:12345-0@lo:502: 00000100:00100000:1.0:1788463119.643034:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a87b6324 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:6684:x1875339408055040:12345-0@lo:502: Request processed in 315us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.643043:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788463119.643442:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000065b557e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408054784:0@lo:8: 00000100:00100000:2.0:1788463119.643472:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408054912 00000100:00100000:2.0:1788463119.643478:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408054912 00000100:00100000:3.0:1788463119.643488:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.643525:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463119.643534:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2440ef3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408054912:12345-0@lo:400: 00000100:00100000:2.0:1788463119.643577:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2440ef3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408054912:12345-0@lo:400: Request processed in 46us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.643584:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463119.643634:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408054784 00000100:00100000:1.0:1788463119.643639:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408054784 00000100:00100000:2.0:1788463119.643652:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5a40abb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+10:6663:x1875339408052608:12345-0@lo:253: Request processed in 151123us (151516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.643663:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463119.643671:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dc3fdb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3275:x1875339408054784:12345-0@lo:8: 00000100:00100000:2.0:1788463119.643677:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00020000:1.0:1788463119.643709:0:6665:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788463119.643751:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009ad27b66 x1875339408054912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463119.643766:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ad27b66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408054912:0@lo:400: 00000100:00100000:0.0:1788463119.644127:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c87e3d08 going to sleep for 11 seconds 00000100:00100000:0.0:1788463119.644145:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000314c404a pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6684:1875339408055040:0@lo:502: 00000020:01000000:0.0:1788463119.644172:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463119.644183:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463119.644185:0:6684:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788463119.644188:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788463119.644294:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788463119.644318:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788463119.644327:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: 000000005b253e34/0xc3fe72277ee3577b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.644337:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: 000000005b253e34/0xc3fe72277ee3577b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463119.644348:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463119.644350:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c88d5800 from 1 10000000:01000000:2.0:1788463119.644353:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:1.0:1788463119.644363:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dc3fdb8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3275:x1875339408054784:12345-0@lo:8: Request processed in 691us (876us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788463119.644372:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788463119.644381:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee3579e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.644390:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee3579e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.644399:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee3579e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.644412:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d595c949 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408055168:0@lo:101: 00000100:00100000:2.0:1788463119.644444:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.644474:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5ab980 going to sleep for 11 seconds 00000100:00080000:0.0:1788463119.644505:0:3275:0:(import.c:65:import_set_state_nolock()) 00000000189065b6 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463119.644515:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788463119.644518:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000065b557e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408054784:0@lo:8: 00000100:00100000:1.0:1788463119.644535:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408055168 00000100:00100000:1.0:1788463119.644541:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408055168 00000100:00100000:3.0:1788463119.644566:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8c4928b pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408052608:0@lo:253: 10000000:01000000:3.0:1788463119.644578:0:6663:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000100:00100000:1.0:1788463119.644582:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000020:01000004:3.0:1788463119.644583:0:6663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788463119.644588:0:6663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788463119.644590:0:6663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463119.644591:0:6663:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788463119.644593:0:6663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463119.644596:0:6663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:1.0:1788463119.644596:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8c1a0d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+10:5813:x1875339408055168:12345-0@lo:101: 00000020:01000004:3.0:1788463119.644599:0:6663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463119.644602:0:6663:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00010000:00010000:1.0:1788463119.644610:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463119.644626:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000084b51ebd/0xc3fe72277ee357a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee3579e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.644649:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084b51ebd/0xc3fe72277ee357a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee3579e expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.644659:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000084b51ebd/0xc3fe72277ee357a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3579e expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.644666:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000084b51ebd, rc 0) 00000020:01000004:3.0:1788463119.644751:0:6663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463119.644753:0:6663:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788463119.644771:0:6663:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000016880843 from lustre-OST0000 00000100:00100000:1.0:1788463119.644776:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8c1a0d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+11:5813:x1875339408055168:12345-0@lo:101: Request processed in 182us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.644784:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 10000000:01000000:3.0:1788463119.644791:0:6663:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788463119.644795:0:6663:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788463119.644801:0:6663:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ba5c7d7cd40 local copy 10000000:01000000:3.0:1788463119.644805:0:6663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:2.0:1788463119.645139:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d595c949 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408055168:0@lo:101: 00010000:00010000:2.0:1788463119.645160:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee3579e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.645168:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: 000000000555d6eb/0xc3fe72277ee3579e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.645192:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: 000000005bf9604f/0xc3fe72277ee357ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.645202:0:6663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.111@tcp lock: 000000005bf9604f/0xc3fe72277ee357ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.645214:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d595c949 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408055424:0@lo:501: 00010000:00010000:3.0:1788463119.645223:0:6663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: 000000005bf9604f/0xc3fe72277ee357ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463119.645239:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8c4928b pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408055296:0@lo:101: 00000100:00100000:3.0:1788463119.645268:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.645330:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set 000000002160c384 going to sleep for 11 seconds 00000100:00100000:0.0:1788463119.645381:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408055296 00000100:00100000:0.0:1788463119.645385:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408055296 00000100:00100000:2.0:1788463119.645428:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.645519:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408055424 00000100:00100000:0.0:1788463119.645524:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408055424 00000100:00100000:2.0:1788463119.645527:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5ab980 going to sleep for 11 seconds 00000100:00100000:0.0:1788463119.645545:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788463119.645552:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002eb1944c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:6663:x1875339408055296:12345-0@lo:101: 00010000:00010000:0.0:1788463119.645559:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463119.645567:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee357b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee357ac expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.645581:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee357b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee357ac expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.645589:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f8ad3a97/0xc3fe72277ee357b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee357ac expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.645595:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f8ad3a97, rc 0) 00000100:00100000:3.0:1788463119.645705:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463119.645713:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b472fcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408055424:12345-0@lo:501: 00000100:00100000:3.0:1788463119.646299:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b472fcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408055424:12345-0@lo:501: Request processed in 587us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463119.646308:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788463119.646427:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d595c949 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408055424:0@lo:501: 00000100:00100000:2.0:1788463119.646459:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d595c949 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408055552:0@lo:503: 00000100:00100000:2.0:1788463119.646495:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.646520:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d5ab980 going to sleep for 11 seconds 00000100:00100000:3.0:1788463119.646620:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408055552 00000100:00100000:3.0:1788463119.646625:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408055552 00000100:00100000:3.0:1788463119.646645:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463119.646650:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de3ff0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408055552:12345-0@lo:503: 00000100:00100000:3.0:1788463119.647015:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de3ff0c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408055552:12345-0@lo:503: Request processed in 365us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463119.647022:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788463119.647350:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d595c949 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408055552:0@lo:503: 00000100:00100000:2.0:1788463119.647836:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d595c949 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6687:1875339408055680:0@lo:502: 00000100:00100000:2.0:1788463119.647880:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.647931:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006cacb2c going to sleep for 11 seconds 00000100:00100000:3.0:1788463119.648189:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408055680 00000100:00100000:3.0:1788463119.648195:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408055680 00000100:00100000:3.0:1788463119.648227:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788463119.648235:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001649379c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:6687:x1875339408055680:12345-0@lo:502: 00000100:00100000:3.0:1788463119.648456:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001649379c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:6687:x1875339408055680:12345-0@lo:502: Request processed in 221us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463119.648463:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788463119.648604:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d595c949 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6687:1875339408055680:0@lo:502: 00000020:01000000:2.0:1788463119.648649:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463119.648659:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463119.648662:0:6687:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788463119.648671:0:6687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba5c88d5800 00000020:00000080:2.0:1788463119.648674:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788463119.648754:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6687:1875339408055808:0@lo:502: 00000100:00100000:2.0:1788463119.648791:0:6687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.648803:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c85289c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463119.649193:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408055808 00000100:00100000:3.0:1788463119.649204:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408055808 00000100:00100000:3.0:1788463119.649229:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788463119.649236:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:6687:x1875339408055808:12345-0@lo:502: 00000100:00100000:3.0:1788463119.649388:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:6687:x1875339408055808:12345-0@lo:502: Request processed in 152us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463119.649395:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463119.650119:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:6663:x1875339408055296:12345-0@lo:101: Request processed in 4563us (4846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.650127:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788463119.650313:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408055296:0@lo:101: 00010000:00010000:1.0:1788463119.650334:0:6663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.650347:0:6663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463119.650454:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408055936:0@lo:501: 00000100:00100000:1.0:1788463119.650487:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463119.650524:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c10860c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.650565:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:6687:1875339408055808:0@lo:502: 00000020:01000000:2.0:1788463119.650596:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463119.650603:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463119.650606:0:6687:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788463119.650610:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788463119.650701:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788463119.650720:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463119.650729:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee3579e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.650737:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee3579e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463119.650747:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00000100:00100000:3.0:1788463119.650836:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408055936 00000100:00100000:3.0:1788463119.650842:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408055936 00000100:00100000:3.0:1788463119.650882:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788463119.650892:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+12:6663:x1875339408055936:12345-0@lo:501: 00000100:00100000:3.0:1788463119.651143:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+12:6663:x1875339408055936:12345-0@lo:501: Request processed in 251us (653us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463119.651150:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788463119.651326:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408055936:0@lo:501: 10000000:01000000:0.0:1788463119.651342:0:6663:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788463119.651370:0:6663:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788463119.651384:0:6663:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.651392:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.651399:0:6663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.652082:0:6663:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788463119.652118:0:6663:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ba5c2e32800 10000000:01000000:1.0:1788463119.652212:0:6663:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788463119.652238:0:6663:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ba5c7d7cd40 10000000:01000000:1.0:1788463119.652242:0:6663:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788463119.652246:0:6663:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ba5c7d7cd40 from 1 10000000:01000000:1.0:1788463119.652249:0:6663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788463119.652284:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488400/0xc3fe72277ee357ba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.652293:0:6663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488400/0xc3fe72277ee357ba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.652304:0:6663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488400/0xc3fe72277ee357ba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463119.652321:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408056064:0@lo:101: 00000100:00100000:1.0:1788463119.652361:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463119.652390:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c1086e40 going to sleep for 11 seconds 10000000:01000000:2.0:1788463119.652455:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ba5c7d7cd40 from 1 10000000:01000000:2.0:1788463119.652459:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788463119.652478:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.652486:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.652493:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.652505:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408056192:0@lo:101: 00000100:00100000:2.0:1788463119.652533:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.652550:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c85289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.652565:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408056064 00000100:00100000:2.0:1788463119.652570:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408056064 00000100:00100000:2.0:1788463119.652617:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408056192 00000100:00100000:2.0:1788463119.652621:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408056192 00000100:00100000:2.0:1788463119.652634:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463119.652641:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:6663:x1875339408056064:12345-0@lo:101: 00010000:00010000:2.0:1788463119.652653:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463119.652667:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8cb000/0xc3fe72277ee357c8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee357ba expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.652711:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8cb000/0xc3fe72277ee357c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee357ba expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.652723:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8cb000/0xc3fe72277ee357c8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee357ba expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.652733:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cb000, rc 0) 00000100:00100000:2.0:1788463119.652763:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408056064:12345-0@lo:101: Request processed in 122us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.652770:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463119.652789:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788463119.652795:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408056192:12345-0@lo:101: 00010000:00010000:2.0:1788463119.652801:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463119.652807:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee357cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee357c1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.652834:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee357cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee357c1 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.652842:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee357cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee357c1 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.652858:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cac00, rc 0) 00000100:00100000:2.0:1788463119.652885:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408056192:12345-0@lo:101: Request processed in 89us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.652891:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788463119.652941:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408056192:0@lo:101: 00010000:00010000:2.0:1788463119.652954:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.652963:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.653007:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408056320:0@lo:501: 00000100:00100000:2.0:1788463119.653031:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.653044:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c85289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.653056:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408056320 00000100:00100000:2.0:1788463119.653059:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408056320 00000100:00100000:2.0:1788463119.653087:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788463119.653092:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408056320:12345-0@lo:501: 00010000:00010000:3.0:1788463119.653151:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463119.653159:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x400000000 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.653166:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703a600 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1788463119.653170:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x400000000 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.653179:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x8400000000 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463119.653185:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x9400000000 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463119.653191:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788463119.653293:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408056320:12345-0@lo:501: Request processed in 200us (260us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463119.653301:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1788463119.653329:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.653336:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463119.653353:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.653372:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a600/0xc3fe72277ee357ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3fe72277ee357b3 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.653384:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463119.653386:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463119.653388:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463119.653399:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408056448:0@lo:103: 00000100:00100000:2.0:1788463119.653424:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.653462:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408056448 00000100:00100000:2.0:1788463119.653466:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408056448 00000100:00100000:2.0:1788463119.653498:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463119.653505:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:3276:x1875339408056448:12345-0@lo:103: 00010000:00010000:2.0:1788463119.653515:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788463119.653523:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408056320:0@lo:501: 00010000:00010000:2.0:1788463119.653526:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0030200/0xc3fe72277ee357b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee357ac expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.653536:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:3.0:1788463119.653550:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788463119.653556:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.653559:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:3276:x1875339408056448:12345-0@lo:103: Request processed in 55us (134us total) trans 0 rc 0/0 00010000:00010000:3.0:1788463119.653564:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.653565:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463119.653589:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408056448:0@lo:103: 00000100:00100000:1.0:1788463119.653731:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408056064:0@lo:101: 00010000:00010000:1.0:1788463119.653743:0:6663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488400/0xc3fe72277ee357ba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357c8 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.653752:0:6663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488400/0xc3fe72277ee357ba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee357c8 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463119.653769:0:6663:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788463119.653775:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488400/0xc3fe72277ee357ba lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357c8 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.653782:0:6663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488400/0xc3fe72277ee357ba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357c8 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463119.653863:0:6663:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788463119.653869:0:6663:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463119.653875:0:6663:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788463119.653878:0:6663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788463119.653897:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.653904:0:6663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.653912:0:6663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463119.653924:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408056576:0@lo:101: 00000100:00100000:1.0:1788463119.653955:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463119.654034:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c1086e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.654093:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408056576 00000100:00100000:2.0:1788463119.654099:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408056576 00000100:00100000:2.0:1788463119.654175:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788463119.654184:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:6663:x1875339408056576:12345-0@lo:101: 00010000:00010000:2.0:1788463119.654192:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463119.654211:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee357dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee357d6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.654227:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee357dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee357d6 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.654236:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee357dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee357d6 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.654243:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cb400, rc 0) 00000100:00100000:2.0:1788463119.654364:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408056576:12345-0@lo:101: Request processed in 177us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.654370:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788463119.654447:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408056576:0@lo:101: 00010000:00010000:3.0:1788463119.654458:0:6663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.654466:0:6663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463119.654546:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408056704:0@lo:501: 00000100:00100000:3.0:1788463119.654573:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463119.655212:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408056704 00000100:00100000:1.0:1788463119.655219:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408056704 00000100:00100000:1.0:1788463119.655247:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788463119.655253:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408056704:12345-0@lo:501: 00000100:00100000:0.0:1788463119.655379:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aedf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463119.655677:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408056704:12345-0@lo:501: Request processed in 422us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.655704:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788463119.656176:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408056704:0@lo:501: 00000100:00100000:0.0:1788463119.656223:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408056832:0@lo:503: 00000100:00100000:0.0:1788463119.656553:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.656596:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cff900 going to sleep for 11 seconds 00000100:00100000:1.0:1788463119.656652:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408056832 00000100:00100000:1.0:1788463119.656658:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408056832 00000100:00100000:1.0:1788463119.656727:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788463119.656739:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408056832:12345-0@lo:503: 00000100:00100000:1.0:1788463119.657112:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408056832:12345-0@lo:503: Request processed in 375us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.657119:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788463119.657351:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408056832:0@lo:503: 00000040:00080000:2.0:1788463119.659232:0:6663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463119.659322:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408056960:0@lo:502: 00000100:00100000:2.0:1788463119.659397:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.659589:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463119.660186:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408056960 00000100:00100000:0.0:1788463119.660196:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408056960 00000100:00100000:0.0:1788463119.660290:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788463119.660302:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408056960:12345-0@lo:502: 00000100:00100000:0.0:1788463119.660564:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408056960:12345-0@lo:502: Request processed in 264us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.660581:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463119.660664:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408056960:0@lo:502: 00000040:00080000:2.0:1788463119.660990:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788463119.661048:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788463119.661094:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788463119.661145:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788463119.661177:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788463119.661208:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788463119.661237:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057088:0@lo:502: 00000100:00100000:2.0:1788463119.661282:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463119.669046:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408057088 00000100:00100000:2.0:1788463119.669058:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528900 going to sleep for 11 seconds 00000100:00100000:1.0:1788463119.669064:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408057088 00000100:00100000:1.0:1788463119.669331:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788463119.669345:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408057088:12345-0@lo:502: 00000100:00100000:1.0:1788463119.669928:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408057088:12345-0@lo:502: Request processed in 585us (8643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.669937:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788463119.670347:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057088:0@lo:502: 00000040:00080000:2.0:1788463119.670818:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788463119.670855:0:6663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788463119.672299:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788463119.672311:0:6688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788463119.672319:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463119.672322:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788463119.672330:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463119.672349:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ba5e8430000) 00000020:00000080:2.0:1788463119.672376:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788463119.672383:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788463119.672620:0:6688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba5c2e32800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788463119.672630:0:6688:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788463119.672641:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3fe72277ee357eb 00010000:00010000:3.0:1788463119.678908:0:6688:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788463119.679452:0:6688:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788463119.686228:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788463119.686644:0:6688:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788463119.711135:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788463119.711841:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788463119.715718:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788463119.715733:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463119.715740:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463119.715748:0:6688:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788463119.715753:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463119.715757:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463119.715759:0:6688:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463119.715761:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463119.715763:0:6688:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788463119.715829:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463119.715832:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463119.715834:0:6688:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788463119.715837:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788463119.717725:0:6663:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788463119.717776:0:6663:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788463119.717797:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.717812:0:6663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463119.717822:0:6663:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c2e32800 from 1 10000000:01000000:3.0:1788463119.717834:0:6663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463119.717874:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.717882:0:6663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.717892:0:6663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463119.717915:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057216:0@lo:101: 00000100:00100000:3.0:1788463119.718002:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.718063:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aedc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463119.718104:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408057216 00000100:00100000:3.0:1788463119.718112:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408057216 00000100:00100000:3.0:1788463119.718165:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788463119.718174:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:6663:x1875339408057216:12345-0@lo:101: 00010000:00010000:3.0:1788463119.718191:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463119.718207:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5e703aa00/0xc3fe72277ee357f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee357f2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.718248:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5e703aa00/0xc3fe72277ee357f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee357f2 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.718259:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5e703aa00/0xc3fe72277ee357f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee357f2 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.718268:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e703aa00, rc 0) 00000100:00100000:3.0:1788463119.718309:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408057216:12345-0@lo:101: Request processed in 135us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463119.718324:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788463119.718374:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057216:0@lo:101: 00010000:00010000:3.0:1788463119.718389:0:6663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.718399:0:6663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463119.718776:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057344:0@lo:501: 00000100:00100000:3.0:1788463119.718806:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.718825:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aedc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.720530:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408057344 00000100:00100000:2.0:1788463119.720544:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408057344 00000100:00100000:2.0:1788463119.720609:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788463119.720619:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408057344:12345-0@lo:501: 00000100:00100000:0.0:1788463119.725725:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408057344:12345-0@lo:501: Request processed in 5097us (6907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.725742:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788463119.726567:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057344:0@lo:501: 00000100:00100000:3.0:1788463119.726625:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057472:0@lo:503: 00000100:00100000:3.0:1788463119.726710:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.727544:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aedc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463119.735131:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408057472 00000100:00100000:1.0:1788463119.735152:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408057472 00000100:00100000:1.0:1788463119.735217:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788463119.735297:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408057472:12345-0@lo:503: 00000100:00100000:1.0:1788463119.736666:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408057472:12345-0@lo:503: Request processed in 1367us (9951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.736680:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788463119.738629:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057472:0@lo:503: 00000040:00080000:0.0:1788463119.739111:0:6663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788463119.739194:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057600:0@lo:502: 00000100:00100000:0.0:1788463119.739275:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.739333:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5c34300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.739359:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408057600 00000100:00100000:2.0:1788463119.739366:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408057600 00000100:00100000:2.0:1788463119.739490:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788463119.739502:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408057600:12345-0@lo:502: 00000100:00100000:2.0:1788463119.739738:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408057600:12345-0@lo:502: Request processed in 238us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.739746:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788463119.739878:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057600:0@lo:502: 00000040:00080000:3.0:1788463119.740342:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788463119.740404:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788463119.740499:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057728:0@lo:502: 00000100:00100000:3.0:1788463119.740542:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.740581:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463119.740913:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408057728 00000100:00100000:0.0:1788463119.740920:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408057728 00000100:00100000:0.0:1788463119.740958:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788463119.741032:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408057728:12345-0@lo:502: 00000100:00100000:0.0:1788463119.741432:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408057728:12345-0@lo:502: Request processed in 466us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.741441:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788463119.744177:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057728:0@lo:502: 00000040:00080000:0.0:1788463119.744534:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788463119.744552:0:6663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788463119.745455:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463119.745467:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463119.745470:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788463119.745479:0:6692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba5c2e32800 00000020:00000080:2.0:1788463119.745488:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788463119.745514:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463119.745517:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463119.745519:0:6692:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788463119.745522:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788463119.745722:0:6663:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788463119.745746:0:6663:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788463119.745766:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.745789:0:6663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463119.745843:0:6663:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788463119.745846:0:6663:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ba5c2e32800 10000000:01000000:0.0:1788463119.745850:0:6663:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ba5c2e32800 10000000:01000000:0.0:1788463119.745855:0:6663:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788463119.745861:0:6663:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba5c2e32800 from 1 10000000:01000000:0.0:1788463119.745864:0:6663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463119.745905:0:6663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.745914:0:6663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463119.745926:0:6663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463119.745948:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057856:0@lo:101: 00000100:00100000:0.0:1788463119.746240:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.746289:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5caa880c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463119.746443:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408057856 00000100:00100000:3.0:1788463119.746452:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408057856 00000100:00100000:3.0:1788463119.746497:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788463119.746516:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408057856:12345-0@lo:101: 00010000:00010000:3.0:1788463119.746532:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463119.746547:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5e703a000/0xc3fe72277ee35807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35800 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.746574:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5e703a000/0xc3fe72277ee35807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35800 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.746585:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5e703a000/0xc3fe72277ee35807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35800 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.746594:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e703a000, rc 0) 00000100:00100000:3.0:1788463119.746647:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:6663:x1875339408057856:12345-0@lo:101: Request processed in 132us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463119.746655:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788463119.746731:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057856:0@lo:101: 00010000:00010000:3.0:1788463119.746744:0:6663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.746754:0:6663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463119.747106:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057984:0@lo:501: 00000100:00100000:3.0:1788463119.747137:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.747165:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463119.747186:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408057984 00000100:00100000:3.0:1788463119.747190:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408057984 00000100:00100000:3.0:1788463119.747351:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788463119.747360:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:6663:x1875339408057984:12345-0@lo:501: 00000100:00100000:3.0:1788463119.747670:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:6663:x1875339408057984:12345-0@lo:501: Request processed in 311us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463119.747678:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788463119.747739:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408057984:0@lo:501: 00000100:00100000:3.0:1788463119.747767:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408058112:0@lo:503: 00000100:00100000:3.0:1788463119.747950:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.748015:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463119.748030:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408058112 00000100:00100000:3.0:1788463119.748034:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408058112 00000100:00100000:2.0:1788463119.748343:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788463119.748355:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:6663:x1875339408058112:12345-0@lo:503: 00000100:00100000:2.0:1788463119.748662:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:6663:x1875339408058112:12345-0@lo:503: Request processed in 310us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.748670:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788463119.748912:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408058112:0@lo:503: 00000040:00080000:3.0:1788463119.749942:0:6663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463119.750106:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408058240:0@lo:502: 00000100:00100000:3.0:1788463119.750179:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.750386:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463119.750494:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408058240 00000100:00100000:0.0:1788463119.750501:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408058240 00000100:00100000:0.0:1788463119.750583:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463119.750594:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+16:6663:x1875339408058240:12345-0@lo:502: 00000100:00100000:0.0:1788463119.751173:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+16:6663:x1875339408058240:12345-0@lo:502: Request processed in 578us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.751181:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788463119.751445:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408058240:0@lo:502: 00000040:00080000:3.0:1788463119.751785:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788463119.751842:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788463119.751876:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788463119.751924:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788463119.751962:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788463119.752594:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788463119.752637:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788463119.752673:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788463119.752896:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788463119.752933:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788463119.753384:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788463119.753559:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788463119.753609:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788463119.753646:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788463119.754123:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788463119.754170:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788463119.754325:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788463119.754378:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788463119.754415:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788463119.755376:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788463119.755643:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788463119.755704:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788463119.755742:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788463119.755790:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788463119.755833:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788463119.755867:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788463119.755943:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788463119.755995:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788463119.756056:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408058368:0@lo:502: 00000100:00100000:0.0:1788463119.756161:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.756333:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5d2731f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463119.756525:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408058368 00000100:00100000:2.0:1788463119.756533:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408058368 00000100:00100000:2.0:1788463119.756588:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788463119.756598:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:6663:x1875339408058368:12345-0@lo:502: 00000100:00100000:2.0:1788463119.756852:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:6663:x1875339408058368:12345-0@lo:502: Request processed in 254us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.756860:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463119.757083:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408058368:0@lo:502: 00000040:00080000:0.0:1788463119.757397:0:6663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788463119.757412:0:6663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788463119.758613:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788463119.758640:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ba4c54acd40) 00000020:00000080:0.0:1788463119.758663:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lwp with refcount 2 00000020:01000004:0.0:1788463119.759091:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba5c2e32800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788463119.759097:0:6693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ba5c2e32800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788463119.759099:0:6693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba5c2e32800 3 00010000:00080000:0.0:1788463119.759134:0:6693:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ba4c54b5800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1788463119.764669:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-3 is initialized 00000020:00000080:0.0:1788463119.765383:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788463119.766085:0:6693:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788463119.766231:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc3fe72277ee35815 00000100:00080000:0.0:1788463119.766245:0:6693:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463119.766254:0:6693:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ba4c54b5800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463119.766297:0:6693:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5ec8f1180 x1875339408058496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463119.766348:0:6693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788463119.767428:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875339408058496:0@lo:38: 00000100:00100000:3.0:1788463119.767536:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463119.767650:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408058496 00000100:00100000:0.0:1788463119.767658:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408058496 00000100:00100000:0.0:1788463119.767712:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1788463119.767917:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788463119.767982:0:6663:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788463119.768014:0:6663:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788463119.768032:0:6663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.768044:0:6663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788463119.768105:0:6663:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788463119.768108:0:6663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788463119.768109:0:6663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463119.768110:0:6663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463119.768112:0:6663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463119.768113:0:6663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463119.768114:0:6663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463119.768116:0:6663:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463119.768117:0:6663:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463119.768119:0:6663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463119.768120:0:6663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788463119.768126:0:6663:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788463119.768128:0:6663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788463119.768129:0:6663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788463119.768130:0:6663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463119.768137:0:6663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463119.768138:0:6663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463119.768139:0:6663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463119.768140:0:6663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463119.768141:0:6663:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463119.768142:0:6663:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463119.768142:0:6663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463119.768143:0:6663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788463119.768174:0:6663:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788463119.768197:0:6663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408058624:0@lo:253: 00000100:00100000:3.0:1788463119.768368:0:6663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.768401:0:6663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463119.768474:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408058624 00000100:00100000:3.0:1788463119.768479:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408058624 00000100:00100000:3.0:1788463119.768514:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788463119.768522:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+16:6663:x1875339408058624:12345-0@lo:253: 20000000:01000000:3.0:1788463119.768551:0:5809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788463119.768567:0:5809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788463119.768630:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3275:x1875339408058496:12345-0@lo:38: 00010000:00080000:0.0:1788463119.768653:0:5817:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:0.0:1788463119.768719:0:5817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc3fe72277ee3581c 00000004:00100000:0.0:1788463119.768735:0:5817:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788463119.768768:0:5817:0:(import.c:65:import_set_state_nolock()) ffff9ba4c54b1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463119.768833:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875339408058496:12345-0@lo:38: Request processed in 206us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.768840:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788463119.769043:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ba5ec8f1180 x1875339408058496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463119.769054:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788463119.769061:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788463119.769080:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788463119.769085:0:3275:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788463119.769087:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba4c54b5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788463119.769093:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875339408058496:0@lo:38: 20000000:01000000:0.0:1788463119.825323:0:5809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788463119.825346:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788463119.825528:0:5832:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788463119.825535:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788463119.825558:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.825596:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee35743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3573c expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.825604:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.825645:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee35743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee3573c expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463119.825660:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee35743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee3573c expref: 16 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463119.825675:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4beb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1875339408058752:0@lo:104: 00000100:00100000:3.0:1788463119.825787:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463119.828365:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aede40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463119.828551:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788463119.828596:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408058752 00000100:00100000:1.0:1788463119.828605:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408058752 00000100:00100000:1.0:1788463119.835384:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463119.835404:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5832:x1875339408058752:12345-0@lo:104: 00010000:00010000:1.0:1788463119.835434:0:6681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031000/0xc3fe72277ee3573c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463119.835536:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463119.835543:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b22050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5832:x1875339408058752:12345-0@lo:104: Request processed in 147us (9757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463119.835565:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463119.835719:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4beb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1875339408058752:0@lo:104: 00010000:00010000:3.0:1788463119.835744:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.835998:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463119.836007:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031000/0xc3fe72277ee3573c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836015:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0031000 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1788463119.836021:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031000/0xc3fe72277ee3573c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836030:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031000/0xc3fe72277ee3573c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463119.836038:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031000/0xc3fe72277ee3573c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463119.836052:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463119.836109:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031000/0xc3fe72277ee3573c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836116:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463119.836143:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031000/0xc3fe72277ee3573c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836150:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031000/0xc3fe72277ee3573c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35743 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836168:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463119.836169:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463119.836171:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463119.836182:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463119.836195:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408058880:0@lo:103: 00000100:00100000:2.0:1788463119.836241:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463119.836298:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408058880 00000100:00100000:2.0:1788463119.836304:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408058880 00010000:00010000:2.0:1788463119.836326:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee35743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3573c expref: 17 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463119.836350:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463119.836358:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c8990050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:3276:x1875339408058880:12345-0@lo:103: 00010000:00010000:2.0:1788463119.836369:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463119.836374:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee35743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3573c expref: 17 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836386:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee35743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee3573c expref: 17 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836409:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee35743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee3573c expref: 17 pid: 5811 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836436:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836444:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788463119.836460:0:5803:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010926612s 00010000:00010000:2.0:1788463119.836464:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836472:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836479:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836485:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836490:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703a600 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463119.836494:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836503:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836518:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836538:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463119.836567:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c8990050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3276:x1875339408058880:12345-0@lo:103: Request processed in 210us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463119.836574:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463119.836629:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408058880:0@lo:103: 00010000:00010000:2.0:1788463119.836646:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836654:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463119.836660:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee35823 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463119.837641:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+15:6663:x1875339408058624:12345-0@lo:253: Request processed in 69115us (69268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463119.837651:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788463119.838017:0:6663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:6663:1875339408058624:0@lo:253: 10000000:01000000:3.0:1788463119.838034:0:6663:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788463119.838038:0:6663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788463119.838039:0:6663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788463119.838040:0:6663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463119.838041:0:6663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463119.838042:0:6663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463119.838044:0:6663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463119.838045:0:6663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463119.838047:0:6663:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463119.838049:0:6663:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463119.838062:0:6663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463119.838063:0:6663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788463119.838095:0:6663:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788463119.848365:0:6663:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463119.850382:0:6663:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788463119.851269:0:6663:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463119.852218:0:6663:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788463119.855548:0:6663:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463119.856080:0:6663:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788463119.859398:0:6663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788463120.063170:0:6663:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788463120.063178:0:6663:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788463120.063276:0:6663:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788463120.063348:0:6663:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788463120.063382:0:6663:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788463120.063488:0:6663:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788463120.229873:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463121.256374:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463122.277632:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463123.301790:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463124.324800:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788463125.030572:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788463125.030583:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788463125.030587:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ba4c513e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788463125.030597:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 151 00000100:00080000:3.0:1788463125.030603:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788463125.030611:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ba4c513e000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:3.0:1788463125.030633:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5f4be9500 x1875339408059264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463125.030713:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408059136:0@lo:400: 00000100:00100000:3.0:1788463125.030782:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463125.030840:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463125.030847:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408059008:0@lo:400: 00000100:00100000:3.0:1788463125.030878:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463125.030905:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408059264:0@lo:8: 00000100:00100000:3.0:1788463125.030932:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463125.030962:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408059392:0@lo:400: 00000100:00100000:3.0:1788463125.030999:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463125.031045:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408059136 00000100:00100000:3.0:1788463125.031053:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408059136 00000100:00100000:3.0:1788463125.031100:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408059392 00000100:00100000:3.0:1788463125.031103:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408059392 00000100:00100000:3.0:1788463125.031142:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463125.031150:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408059136:12345-0@lo:400: 00000100:00100000:3.0:1788463125.031208:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408059136:12345-0@lo:400: Request processed in 59us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463125.031233:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463125.031251:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463125.031257:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408059392:12345-0@lo:400: 00000100:00100000:3.0:1788463125.031290:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408059392:12345-0@lo:400: Request processed in 33us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463125.031296:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463125.031314:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408059008 00000100:00100000:3.0:1788463125.031317:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408059008 00000100:00100000:3.0:1788463125.031343:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788463125.031349:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:3279:x1875339408059008:12345-0@lo:400: 00000100:00100000:3.0:1788463125.031378:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:3279:x1875339408059008:12345-0@lo:400: Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463125.031384:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788463125.031417:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408059264 00000100:00100000:3.0:1788463125.031421:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408059264 00000100:00100000:3.0:1788463125.031439:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463125.031444:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3275:x1875339408059264:12345-0@lo:8: 00010000:00080000:3.0:1788463125.031467:0:6668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:3.0:1788463125.031498:0:6668:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3fe72277ee3582a 00002000:00100000:3.0:1788463125.031541:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ba4c5139000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788463125.031546:0:6668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788463125.031551:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788463125.031681:0:6668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788463125.031842:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788463125.031867:0:6668:0:(import.c:65:import_set_state_nolock()) ffff9ba4c513d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463125.031909:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3275:x1875339408059264:12345-0@lo:8: Request processed in 463us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463125.031923:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788463125.031986:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4be9500 x1875339408059264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463125.031997:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788463125.032005:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788463125.032013:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788463125.032019:0:3275:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788463125.032021:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba4c513e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788463125.032041:0:3275:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788463125.032046:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408059264:0@lo:8: 00010000:00080000:3.0:1788463125.032433:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4beb480 x1875339408059392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463125.032445:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408059392:0@lo:400: 00000100:00100000:3.0:1788463125.032600:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408059008:0@lo:400: 00010000:00080000:3.0:1788463125.032614:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4beb800 x1875339408059136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463125.032624:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408059136:0@lo:400: 00000004:00080000:1.0:1788463125.033220:0:6685:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788463125.033777:0:6685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 156644092087ns, next at 0ns, rc = 0 00000100:00080000:2.0:1788463125.033941:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788463125.109094:0:6686:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788463125.109131:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6686:1875339408059648:0@lo:7: 00000100:00100000:3.0:1788463125.109207:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463125.109270:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5d23900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463125.109295:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463125.109310:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408059520:0@lo:13: 00000100:00100000:3.0:1788463125.110595:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463125.110679:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408059648 00000100:00100000:3.0:1788463125.110702:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408059648 00000100:00100000:3.0:1788463125.110759:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463125.110769:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6686:x1875339408059648:12345-0@lo:7: 00000100:00100000:2.0:1788463125.112800:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408059520 00000100:00100000:2.0:1788463125.112818:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408059520 00000100:00100000:2.0:1788463125.112873:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463125.112883:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408059520:12345-0@lo:13: 00002000:00000024:2.0:1788463125.112930:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788463125.113032:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408059520:12345-0@lo:13: Request processed in 151us (2456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463125.113040:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788463125.113066:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463125.114894:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4beb800 x1875339408059520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463125.114930:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408059520:0@lo:13: 00002000:00080000:3.0:1788463125.124873:0:6667:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788463125.124882:0:6667:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788463125.124994:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6686:x1875339408059648:12345-0@lo:7: Request processed in 14223us (15783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463125.125006:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788463125.125064:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4be9f80 x1875339408059648/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788463141 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463125.125080:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6686:1875339408059648:0@lo:7: 00000004:00080000:3.0:1788463125.125094:0:6686:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788463125.125135:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6686:1875339408059776:0@lo:5: 00000100:00100000:3.0:1788463125.125170:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463125.125208:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5d23900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463125.125230:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408059776 00000100:00100000:3.0:1788463125.125236:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408059776 00000100:00100000:3.0:1788463125.125279:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463125.125287:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6686:x1875339408059776:12345-0@lo:5: 00002000:00080000:3.0:1788463125.125316:0:6665:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788463125.125319:0:6665:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788463125.125526:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6686:x1875339408059776:12345-0@lo:5: Request processed in 238us (354us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788463125.125545:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788463125.125578:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4be9f80 x1875339408059776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463141 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463125.125589:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6686:1875339408059776:0@lo:5: 00000004:00080000:3.0:1788463125.125597:0:6686:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788463125.125619:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6686:1875339408059904:0@lo:700: 00000100:00100000:3.0:1788463125.125643:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463125.125659:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5d23900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463125.125676:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408059904 00000100:00100000:3.0:1788463125.125680:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408059904 00000100:00100000:3.0:1788463125.125730:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463125.125737:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6686:x1875339408059904:12345-0@lo:700: 00000100:00100000:3.0:1788463125.125762:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6674:1875339408060032:0@lo:700: 00000100:00100000:3.0:1788463125.125790:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463125.125807:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5d23d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463125.125827:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408060032 00000100:00100000:3.0:1788463125.125831:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408060032 00000100:00100000:3.0:1788463125.125857:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463125.125862:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6674:x1875339408060032:12345-0@lo:700: 00000004:00080000:2.0:1788463125.189578:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1788463125.262245:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788463125.269550:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6674:x1875339408060032:12345-0@lo:700: Request processed in 143673us (143745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463125.269577:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788463125.269654:0:6674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4bebb80 x1875339408060032/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788463141 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463125.269670:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bebb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6674:1875339408060032:0@lo:700: 40000000:02000000:1.0:1788463125.269714:0:6674:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:1.0:1788463125.351153:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788463125.398936:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1788463125.398968:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788463125.399214:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6686:x1875339408059904:12345-0@lo:700: Request processed in 273472us (273564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463125.399232:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788463125.399296:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4be8a80 x1875339408059904/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788463141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463125.399380:0:6686:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788463125.399402:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6686:1875339408059904:0@lo:700: 00000004:02000040:1.0:1788463125.454147:0:6686:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788463125.459468:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6686:1875339408060160:0@lo:5: 00000100:00100000:1.0:1788463125.459552:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463125.459630:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c1086840 going to sleep for 11 seconds 00000100:00100000:3.0:1788463125.461468:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408060160 00000100:00100000:3.0:1788463125.461481:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408060160 00000100:00100000:3.0:1788463125.461543:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788463125.461553:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6686:x1875339408060160:12345-0@lo:5: 00002000:00080000:3.0:1788463125.469317:0:6665:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788463125.469340:0:6665:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788463125.472881:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7958380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6686:x1875339408060160:12345-0@lo:5: Request processed in 11321us (13320us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788463125.472895:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788463125.473129:0:6686:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f795aa00 x1875339408060160/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463141 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463125.473147:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6686:1875339408060160:0@lo:5: 00000004:00080000:1.0:1788463125.473163:0:6686:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788463126.376820:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463127.154078:0:7038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788463127.400188:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463128.421789:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788463129.124963:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788463129.124980:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ba5c88d5800 from 4 10000000:01000000:2.0:1788463129.124989:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788463129.125060:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463129.125077:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463129.125093:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463129.125129:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408060288:0@lo:101: 00000100:00100000:2.0:1788463129.125242:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463129.125335:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec066c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463129.125535:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408060288 00000100:00100000:0.0:1788463129.125555:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408060288 00000100:00100000:0.0:1788463129.125631:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788463129.125642:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408060288:12345-0@lo:101: 00010000:00010000:0.0:1788463129.125659:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463129.125678:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35831 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463129.125747:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35831 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463129.125765:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35831 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463129.125778:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0031000, rc 0) 00000100:00100000:0.0:1788463129.125849:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408060288:12345-0@lo:101: Request processed in 208us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463129.125856:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788463129.126112:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408060288:0@lo:101: 00010000:00010000:2.0:1788463129.126139:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463129.126151:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463129.126231:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408060416:0@lo:256: 00000100:00100000:2.0:1788463129.126286:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463129.126326:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec066c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463129.126405:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408060416 00000100:00100000:0.0:1788463129.126411:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408060416 00000100:00100000:0.0:1788463129.126454:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788463129.126464:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408060416:12345-0@lo:256: 20000000:01000000:0.0:1788463129.126483:0:5811:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788463129.126506:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788463129.126510:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788463129.126613:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408060416:12345-0@lo:256: Request processed in 149us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463129.126621:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788463129.128597:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408060416:0@lo:256: 10000000:01000000:2.0:1788463129.128777:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788463129.128791:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463129.128805:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463129.447421:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463130.149050:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408060544:0@lo:400: 00000100:00100000:0.0:1788463130.149192:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463130.149440:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408060544 00000100:00100000:2.0:1788463130.149453:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408060544 00000100:00100000:2.0:1788463130.149533:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788463130.149546:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3278:x1875339408060544:12345-0@lo:400: 00000100:00100000:0.0:1788463130.150318:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408061056:0@lo:400: 00000100:00100000:0.0:1788463130.150370:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463130.150616:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408060928:0@lo:400: 00000100:00100000:1.0:1788463130.150660:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463130.150702:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463130.150708:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408060800:0@lo:400: 00000100:00100000:1.0:1788463130.150765:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463130.150829:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408061056 00000100:00100000:1.0:1788463130.150837:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408061056 00000100:00100000:1.0:1788463130.150919:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408060800 00000100:00100000:1.0:1788463130.150924:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408060800 00000100:00100000:1.0:1788463130.150942:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463130.150951:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408061056:12345-0@lo:400: 00000100:00100000:1.0:1788463130.150999:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408061056:12345-0@lo:400: Request processed in 48us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463130.151006:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463130.151026:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463130.151031:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408060800:12345-0@lo:400: 00000100:00100000:1.0:1788463130.151065:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408060800:12345-0@lo:400: Request processed in 33us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463130.151071:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463130.151104:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408060672:0@lo:13: 00000100:00100000:1.0:1788463130.151136:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788463130.156163:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4be8000 x1875339408060800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463130.156191:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408060800:0@lo:400: 00000100:00100000:1.0:1788463130.156391:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408060928 00000100:00100000:1.0:1788463130.156404:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408060928 00000100:00100000:1.0:1788463130.156484:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463130.156496:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1875339408060928:12345-0@lo:400: 00000100:00100000:1.0:1788463130.156608:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1875339408060928:12345-0@lo:400: Request processed in 113us (5947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463130.156617:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788463130.156678:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4bea300 x1875339408060928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463130.156714:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408060928:0@lo:400: 00000100:00080000:1.0:1788463130.156755:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463130.156762:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463130.156791:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408060672 00000100:00100000:1.0:1788463130.156795:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408060672 00000100:00100000:1.0:1788463130.156830:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463130.156957:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875339408060672:12345-0@lo:13: 00002000:00000024:1.0:1788463130.156998:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463130.157049:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7958e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875339408060672:12345-0@lo:13: Request processed in 95us (5912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463130.157055:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788463130.157085:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f7958a80 x1875339408060672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463130.157120:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408060672:0@lo:13: 00000100:00100000:2.0:1788463130.159234:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3278:x1875339408060544:12345-0@lo:400: Request processed in 9659us (10011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463130.159252:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788463130.161438:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408060544:0@lo:400: 00010000:00080000:0.0:1788463130.161516:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f4bead80 x1875339408061056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463130.161531:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408061056:0@lo:400: 00010000:00010000:1.0:1788463130.469721:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788463130.817488:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788463131.494812:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463132.516776:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463133.542116:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463134.565125:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463135.268862:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408061184:0@lo:400: 00000100:00100000:3.0:1788463135.268940:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463135.269151:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408061312:0@lo:13: 00000100:00100000:1.0:1788463135.269186:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463135.269230:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408061312 00000100:00100000:1.0:1788463135.269239:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408061312 00000100:00100000:1.0:1788463135.269295:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463135.269305:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408061312:12345-0@lo:13: 00002000:00000024:1.0:1788463135.269340:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463135.269383:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408061312:12345-0@lo:13: Request processed in 79us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463135.269391:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788463135.269410:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788463135.269437:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5f7958a80 x1875339408061312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463135.269448:0:3276:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788463135.269465:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408061312:0@lo:13: 00000100:00100000:3.0:1788463135.272383:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463135.272405:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875339408061568:0@lo:400: 00000100:00100000:3.0:1788463135.272485:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463135.272551:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408061184 00000100:00100000:3.0:1788463135.272559:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408061184 00000100:00100000:3.0:1788463135.272610:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788463135.272619:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3279:x1875339408061184:12345-0@lo:400: 00000100:00100000:3.0:1788463135.272674:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3279:x1875339408061184:12345-0@lo:400: Request processed in 55us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463135.272681:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788463135.272750:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408061184:0@lo:400: 00000100:00100000:2.0:1788463135.272914:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408061440:0@lo:400: 00000100:00100000:2.0:1788463135.272946:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463135.273079:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408061568 00000100:00100000:1.0:1788463135.273086:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408061568 00000100:00100000:1.0:1788463135.273130:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408061440 00000100:00100000:1.0:1788463135.273134:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408061440 00000100:00100000:1.0:1788463135.273149:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463135.273156:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875339408061568:12345-0@lo:400: 00000100:00100000:1.0:1788463135.273202:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875339408061568:12345-0@lo:400: Request processed in 48us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463135.273229:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463135.273243:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463135.273248:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408061440:12345-0@lo:400: 00000100:00100000:1.0:1788463135.273279:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408061440:12345-0@lo:400: Request processed in 30us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463135.273285:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788463135.273352:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788463135.273379:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5fee4f800 x1875339408061440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463135.273392:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408061440:0@lo:400: 00010000:00080000:3.0:1788463135.275207:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5fee4ca80 x1875339408061568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463135.275222:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875339408061568:0@lo:400: 00010000:00010000:3.0:1788463135.589384:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463136.620031:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463137.637281:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463138.661264:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463139.685727:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463140.390879:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463140.390910:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408061696:0@lo:13: 00000100:00100000:2.0:1788463140.391887:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.392259:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408061952:0@lo:400: 00000100:00100000:0.0:1788463140.392309:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.392339:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463140.392344:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408061824:0@lo:400: 00000100:00100000:0.0:1788463140.392387:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.392427:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408061952 00000100:00100000:0.0:1788463140.392437:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408061952 00000100:00100000:0.0:1788463140.392501:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788463140.392511:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408061952:12345-0@lo:400: 00000100:00100000:0.0:1788463140.392572:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408061952:12345-0@lo:400: Request processed in 61us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.392580:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788463140.392621:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408061824 00000100:00100000:0.0:1788463140.392625:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408061824 00000100:00100000:0.0:1788463140.392655:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788463140.392663:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3277:x1875339408061824:12345-0@lo:400: 00000100:00100000:0.0:1788463140.392740:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3277:x1875339408061824:12345-0@lo:400: Request processed in 78us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.392761:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788463140.392823:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408061824:0@lo:400: 00010000:00080000:0.0:1788463140.392840:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5ec8f3480 x1875339408061952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463140.392854:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408061952:0@lo:400: 00000100:00100000:0.0:1788463140.392883:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408062080:0@lo:400: 00000100:00100000:0.0:1788463140.392908:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.392940:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408062080 00000100:00100000:0.0:1788463140.392944:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408062080 00000100:00100000:0.0:1788463140.392979:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788463140.392986:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408062080:12345-0@lo:400: 00000100:00100000:0.0:1788463140.393019:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408062080:12345-0@lo:400: Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.393024:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788463140.393041:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788463140.393058:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5ec8f0e00 x1875339408062080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463140.393067:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408062080:0@lo:400: 00000100:00100000:1.0:1788463140.393478:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408061696 00000100:00100000:1.0:1788463140.393485:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408061696 00000100:00100000:1.0:1788463140.393542:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463140.393551:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408061696:12345-0@lo:13: 00002000:00000024:1.0:1788463140.393602:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463140.393648:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408061696:12345-0@lo:13: Request processed in 98us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463140.393654:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788463140.394598:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463140.394640:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5fee4f800 x1875339408061696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463140.394663:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408061696:0@lo:13: 00000020:01000004:2.0:1788463140.565987:0:7617:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788463140.565992:0:7617:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788463140.566386:0:7617:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ba4c5230000 00000020:01000004:2.0:1788463140.566410:0:7617:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788463140.566426:0:7617:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788463140.566444:0:7617:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ba5e8433380) 00000020:00000080:2.0:1788463140.566463:0:7617:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788463140.580226:0:7617:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788463140.580487:0:7617:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788463140.599985:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788463140.605772:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788463140.605811:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788463140.605883:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788463140.605913:0:7617:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788463140.606401:0:7617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788463140.606416:0:7617:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788463140.606430:0:7617:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3fe72277ee35846 00000020:01000004:3.0:1788463140.606439:0:7617:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788463140.606468:0:7617:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788463140.606472:0:7617:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788463140.606479:0:7617:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788463140.606509:0:7617:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788463140.606514:0:7617:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788463140.622900:0:7617:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788463140.622952:0:7617:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.111@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788463140.622957:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788463140.622959:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788463140.622961:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463140.622962:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463140.622963:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463140.622965:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463140.622966:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463140.622968:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463140.622969:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463140.622971:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463140.622972:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788463140.622977:0:7617:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788463140.622980:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788463140.622981:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788463140.622982:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463140.622983:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463140.622984:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463140.622985:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463140.622986:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463140.622987:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788463140.622988:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788463140.622989:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463140.622995:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788463140.623117:0:7617:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788463140.623146:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408062208:0@lo:253: 00000100:00100000:3.0:1788463140.623261:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463140.623437:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ce900 going to sleep for 11 seconds 00000100:00100000:1.0:1788463140.623561:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408062208 00000100:00100000:1.0:1788463140.623573:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408062208 00000100:00100000:1.0:1788463140.623731:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788463140.623744:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:7617:x1875339408062208:12345-0@lo:253: 20000000:01000000:1.0:1788463140.623786:0:5811:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788463140.623792:0:5811:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788463140.623799:0:5811:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788463140.623805:0:5811:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788463140.624975:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463140.625215:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788463140.625232:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788463140.625284:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788463140.625293:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788463140.625323:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788463140.625383:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788463140.625824:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788463140.625847:0:5811:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.111@tcp 20000000:01000000:1.0:1788463140.625849:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.111@tcp (null) (null) (null) 00000040:00080000:1.0:1788463140.625883:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788463140.625891:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788463140.625940:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788463140.625947:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.111@tcp (null) (null) 00000040:00080000:1.0:1788463140.625978:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788463140.625987:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788463140.626015:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788463140.626059:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788463140.627474:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788463140.627508:0:5811:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.111@tcp 20000000:01000000:1.0:1788463140.627510:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.111@tcp (null) (null) (null) 00000040:00080000:1.0:1788463140.627542:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788463140.627550:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788463140.627579:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788463140.627585:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.111@tcp (null) (null) 00000040:00080000:1.0:1788463140.627615:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788463140.627624:0:5811:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788463140.627678:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788463140.627746:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788463140.627764:0:5811:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788463140.627767:0:5811:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788463140.627772:0:5811:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788463140.627791:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788463140.627795:0:5811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788463140.627846:0:5811:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788463140.627849:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463140.628887:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463140.628982:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463140.629094:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788463140.629488:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788463140.629533:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788463140.629612:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788463140.629627:0:5811:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788463140.629630:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463140.630495:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463140.630559:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463140.630610:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788463140.631103:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788463140.631152:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788463140.631191:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788463140.631203:0:5811:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788463140.631206:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788463140.631806:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788463140.631863:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788463140.631922:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788463140.632285:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788463140.632323:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788463140.632380:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788463140.632392:0:5811:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788463140.632395:0:5811:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788463140.632975:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788463140.633308:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788463140.633348:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788463140.633451:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788463140.633468:0:5811:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788463140.633471:0:5811:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788463140.633485:0:5811:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788463140.633519:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.633547:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.633555:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35782 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3577b expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.633563:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee357cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee357c1 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.633578:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee357dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee357d6 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.633586:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5e703a000/0xc3fe72277ee35807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35800 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.633595:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.633650:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5e703a000/0xc3fe72277ee35807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35800 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.633888:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5e703a000/0xc3fe72277ee35807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35800 expref: 16 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463140.633910:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408062336:0@lo:104: 00000100:00100000:1.0:1788463140.634101:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463140.634206:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee357dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee357d6 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.634216:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee357dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee357d6 expref: 16 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463140.634226:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408062464:0@lo:104: 00000100:00100000:1.0:1788463140.634250:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463140.634365:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee357cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee357c1 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.634375:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee357cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee357c1 expref: 16 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463140.634395:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408062592:0@lo:104: 00000100:00100000:1.0:1788463140.634421:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463140.634485:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408062336 00000100:00100000:3.0:1788463140.634497:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408062336 00000100:00100000:3.0:1788463140.634619:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408062464 00000100:00100000:3.0:1788463140.634623:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408062464 00010000:00010000:1.0:1788463140.634891:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee3577b expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.634902:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35782 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee3577b expref: 16 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463140.634912:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408062720:0@lo:104: 00000100:00100000:1.0:1788463140.634938:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.634964:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408062592 00000100:00100000:2.0:1788463140.634968:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408062592 00000100:00100000:2.0:1788463140.634994:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463140.635004:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+5:5811:x1875339408062336:12345-0@lo:104: 00010000:00010000:2.0:1788463140.635035:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.635099:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788463140.635106:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+5:5811:x1875339408062336:12345-0@lo:104: Request processed in 103us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.635113:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463140.635137:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463140.635142:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+4:5811:x1875339408062464:12345-0@lo:104: 00010000:00010000:2.0:1788463140.635150:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.635182:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788463140.635186:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+4:5811:x1875339408062464:12345-0@lo:104: Request processed in 45us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.635191:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463140.635215:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788463140.635222:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5811:x1875339408062592:12345-0@lo:104: 00010000:00010000:2.0:1788463140.635231:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.635256:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788463140.635260:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5811:x1875339408062592:12345-0@lo:104: Request processed in 40us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.635266:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788463140.635540:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788463140.635548:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.635557:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030a00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463140.635562:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.635573:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463140.635581:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463140.635588:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463140.635657:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.635675:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463140.635734:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.635742:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030a00/0xc3fe72277ee35800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35807 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.635755:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463140.635758:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.635764:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463140.635767:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.635774:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463140.635780:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463140.635786:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788463140.635835:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408062848:0@lo:103: 00000100:00100000:0.0:1788463140.635877:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.635946:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408062848 00000100:00100000:0.0:1788463140.635952:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408062848 00010000:00010000:0.0:1788463140.635978:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5e703a000/0xc3fe72277ee35807 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35800 expref: 17 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463140.636006:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463140.636025:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:3279:x1875339408062848:12345-0@lo:103: 00010000:00010000:0.0:1788463140.636037:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463140.636042:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5e703a000/0xc3fe72277ee35807 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35800 expref: 17 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.636055:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5e703a000/0xc3fe72277ee35807 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35800 expref: 17 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.636075:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463140.636101:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:3279:x1875339408062848:12345-0@lo:103: Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.636108:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463140.636151:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408062848:0@lo:103: 00000100:00100000:2.0:1788463140.636294:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408062720 00000100:00100000:2.0:1788463140.636299:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408062720 00000100:00100000:2.0:1788463140.636325:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788463140.636331:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5811:x1875339408062720:12345-0@lo:104: 00010000:00010000:2.0:1788463140.636340:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb600/0xc3fe72277ee3577b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.636370:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788463140.636376:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5811:x1875339408062720:12345-0@lo:104: Request processed in 45us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.636381:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788463140.636566:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.636574:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788463140.636623:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788463140.636642:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.636648:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489800/0xc3fe72277ee357d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357dd expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.636670:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463140.636682:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.636706:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cae00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463140.636710:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.636719:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463140.636725:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463140.636731:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788463140.636856:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463140.636905:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.636918:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 16 pid: 5811 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463140.636932:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408063104:0@lo:104: 00000100:00100000:2.0:1788463140.636973:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.637009:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec148600 going to sleep for 11 seconds 00010000:00010000:2.0:1788463140.637042:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5e703a000/0xc3fe72277ee35807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35800 expref: 16 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463140.637054:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408062336:0@lo:104: 00000100:00100000:2.0:1788463140.637066:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408062464:0@lo:104: 00000100:00100000:2.0:1788463140.637074:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408062592:0@lo:104: 00000100:00100000:2.0:1788463140.637080:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408062720:0@lo:104: 00010000:00010000:2.0:1788463140.637443:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463140.637446:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463140.637448:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463140.637478:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb600/0xc3fe72277ee3577b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463140.637485:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cb600 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1788463140.637489:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb600/0xc3fe72277ee3577b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463140.637497:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb600/0xc3fe72277ee3577b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463140.637503:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb600/0xc3fe72277ee3577b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463140.637522:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463140.637556:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb600/0xc3fe72277ee3577b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463140.637563:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788463140.637674:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408063232:0@lo:103: 00000100:00100000:0.0:1788463140.637733:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.637760:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408062976:0@lo:103: 00000100:00100000:0.0:1788463140.637778:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.637812:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408063232 00000100:00100000:0.0:1788463140.637817:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408063232 00010000:00010000:0.0:1788463140.637844:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35782 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3577b expref: 16 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463140.637879:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408062976 00000100:00100000:0.0:1788463140.637883:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408062976 00010000:00010000:0.0:1788463140.637895:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee357dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee357d6 expref: 17 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463140.637909:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463140.637917:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:3277:x1875339408063232:12345-0@lo:103: 00010000:00010000:0.0:1788463140.637931:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463140.637936:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35782 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3577b expref: 17 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.637946:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35782 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee3577b expref: 17 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.637962:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35782 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee3577b expref: 17 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.637977:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463140.638010:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3277:x1875339408063232:12345-0@lo:103: Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.638164:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463140.638181:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788463140.638187:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:3277:x1875339408062976:12345-0@lo:103: 00010000:00010000:0.0:1788463140.638195:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463140.638200:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee357dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee357d6 expref: 15 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.638209:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee357dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee357d6 expref: 15 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.638229:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee357dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee357d6 expref: 15 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.638239:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463140.638262:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:3277:x1875339408062976:12345-0@lo:103: Request processed in 75us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.638268:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788463140.638292:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408063104 00000100:00100000:0.0:1788463140.638296:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408063104 00000100:00100000:0.0:1788463140.638329:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788463140.638336:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5811:x1875339408063104:12345-0@lo:104: 00010000:00010000:0.0:1788463140.638347:0:5801:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee3576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.638385:0:5801:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463140.638390:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5811:x1875339408063104:12345-0@lo:104: Request processed in 55us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.638396:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788463140.638432:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408063232:0@lo:103: 00000100:00100000:0.0:1788463140.638440:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408062976:0@lo:103: 00010000:00010000:0.0:1788463140.638466:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463140.638605:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463140.638610:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee3576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.638618:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1788463140.638622:0:7623:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee3576d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.638638:0:7623:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee3576d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463140.638645:0:7623:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee3576d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463140.638651:0:7623:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463140.638718:0:7623:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee3576d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.638724:0:7623:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463140.638742:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee3576d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.638749:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee3576d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35774 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463140.638773:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408063360:0@lo:103: 00000100:00100000:0.0:1788463140.638803:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.638841:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408063360 00000100:00100000:0.0:1788463140.638844:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408063360 00010000:00010000:0.0:1788463140.638859:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35774 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 14 pid: 5811 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463140.638876:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788463140.638882:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:3278:x1875339408063360:12345-0@lo:103: 00010000:00010000:0.0:1788463140.638890:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463140.638894:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35774 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 14 pid: 5811 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.638909:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35774 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 14 pid: 5811 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.638921:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463140.638946:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:3278:x1875339408063360:12345-0@lo:103: Request processed in 64us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.638953:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788463140.638982:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408063360:0@lo:103: 00010000:00010000:0.0:1788463140.638992:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463140.638994:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463140.638996:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463140.638999:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463140.639001:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463140.639152:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee3576d expref: 13 pid: 5811 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463140.639163:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5811:1875339408063104:0@lo:104: 00010000:00010000:2.0:1788463140.639197:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.639311:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.639319:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788463140.639357:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408063488:0@lo:103: 00000100:00100000:2.0:1788463140.639391:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.639438:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408063488 00000100:00100000:0.0:1788463140.639443:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408063488 00010000:00010000:0.0:1788463140.639462:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee357cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee357c1 expref: 13 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463140.639483:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788463140.639489:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:3279:x1875339408063488:12345-0@lo:103: 00010000:00010000:0.0:1788463140.639496:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463140.639500:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee357cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee357c1 expref: 13 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639510:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee357cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee357c1 expref: 13 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639522:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee357cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee357c1 expref: 13 pid: 5810 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639548:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639559:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639575:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639583:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639590:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639597:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639602:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463140.639607:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639616:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639631:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.639639:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463140.639777:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb600/0xc3fe72277ee3577b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463140.639787:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb600/0xc3fe72277ee3577b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35782 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463140.639798:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463140.639800:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463140.639802:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463140.639863:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.639870:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee357c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357cf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.639885:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463140.639887:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463140.639889:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463140.639999:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+12:3279:x1875339408063488:12345-0@lo:103: Request processed in 509us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.640088:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788463140.640119:0:5811:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.640128:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.640135:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c1489000/0xc3fe72277ee3584d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788463140.640152:0:5811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788463140.640262:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408063488:0@lo:103: 00000100:00100000:2.0:1788463140.691240:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+11:7617:x1875339408062208:12345-0@lo:253: Request processed in 67483us (67964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.691261:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788463140.691375:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408062208:0@lo:253: 10000000:01000000:3.0:1788463140.691396:0:7617:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788463140.691400:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788463140.691402:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788463140.691403:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463140.691404:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788463140.691406:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463140.691407:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463140.691409:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463140.691411:0:7617:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788463140.691412:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463140.691414:0:7617:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788463140.691443:0:7617:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ba4c5230000 from lustre-OST0001 10000000:01000000:3.0:1788463140.691477:0:7617:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788463140.691481:0:7617:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788463140.691490:0:7617:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ba5c7d7cd40 local copy 10000000:01000000:3.0:1788463140.691495:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788463140.691560:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463140.691575:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463140.691586:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463140.691609:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408063616:0@lo:101: 00000100:00100000:3.0:1788463140.691650:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463140.691775:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ced80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463140.691869:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408063616 00000100:00100000:0.0:1788463140.691878:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408063616 00000100:00100000:0.0:1788463140.692192:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788463140.692206:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+11:7617:x1875339408063616:12345-0@lo:101: 00010000:00010000:0.0:1788463140.692225:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463140.692243:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0030800/0xc3fe72277ee3585b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35854 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.692277:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0030800/0xc3fe72277ee3585b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35854 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.692290:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0030800/0xc3fe72277ee3585b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35854 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.692302:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0030800, rc 0) 00000100:00100000:0.0:1788463140.692397:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:7617:x1875339408063616:12345-0@lo:101: Request processed in 194us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.692404:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788463140.692573:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408063616:0@lo:101: 00010000:00010000:3.0:1788463140.692590:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463140.692601:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463140.692769:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408063744:0@lo:501: 00000100:00100000:3.0:1788463140.692819:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463140.692851:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ced80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463140.692907:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408063744 00000100:00100000:2.0:1788463140.692914:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408063744 00000100:00100000:2.0:1788463140.692955:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463140.692962:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+12:7617:x1875339408063744:12345-0@lo:501: 00000100:00100000:2.0:1788463140.693280:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+12:7617:x1875339408063744:12345-0@lo:501: Request processed in 318us (459us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463140.693289:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463140.693329:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408063744:0@lo:501: 10000000:01000000:2.0:1788463140.693346:0:7617:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788463140.693372:0:7617:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788463140.693379:0:7617:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.693389:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.693396:0:7617:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.693479:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788463140.693505:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ba4c5230000 10000000:01000000:2.0:1788463140.693512:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788463140.693518:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788463140.693520:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463140.693526:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788463140.693529:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788463140.693553:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.693561:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.693571:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463140.693591:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408063872:0@lo:101: 00000100:00100000:2.0:1788463140.693620:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.693635:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89f6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463140.693648:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408063872 00000100:00100000:2.0:1788463140.693652:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408063872 00000100:00100000:2.0:1788463140.693711:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788463140.693719:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+12:7617:x1875339408063872:12345-0@lo:101: 00010000:00010000:2.0:1788463140.693728:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463140.693740:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee35869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35862 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.693762:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee35869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35862 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.693772:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee35869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35862 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.693782:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8ca200, rc 0) 00000100:00100000:2.0:1788463140.693809:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408063872:12345-0@lo:101: Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.693815:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788463140.693847:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408063872:0@lo:101: 00010000:00010000:2.0:1788463140.693858:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.693868:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463140.693946:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064000:0@lo:501: 00000100:00100000:2.0:1788463140.693974:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.693996:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89f6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463140.694008:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408064000 00000100:00100000:2.0:1788463140.694147:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408064000 00000100:00100000:2.0:1788463140.694212:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788463140.694218:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064000:12345-0@lo:501: 00000100:00100000:2.0:1788463140.694397:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064000:12345-0@lo:501: Request processed in 179us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.694404:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788463140.694433:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064000:0@lo:501: 00000100:00100000:2.0:1788463140.694464:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064128:0@lo:503: 00000100:00100000:2.0:1788463140.694506:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.694520:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89f6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463140.694532:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408064128 00000100:00100000:2.0:1788463140.694536:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408064128 00000100:00100000:2.0:1788463140.694552:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788463140.694558:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064128:12345-0@lo:503: 00000100:00100000:2.0:1788463140.694758:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064128:12345-0@lo:503: Request processed in 199us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.694765:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788463140.694804:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064128:0@lo:503: 00000040:00080000:2.0:1788463140.695228:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463140.695319:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064256:0@lo:502: 00000100:00100000:2.0:1788463140.695373:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.695403:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c58ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463140.695424:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408064256 00000100:00100000:2.0:1788463140.695428:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408064256 00000100:00100000:2.0:1788463140.695453:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788463140.695461:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064256:12345-0@lo:502: 00000100:00100000:2.0:1788463140.695624:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064256:12345-0@lo:502: Request processed in 162us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.695630:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788463140.695723:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064256:0@lo:502: 00010000:00010000:1.0:1788463140.696189:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463140.696201:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.696212:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703ba00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463140.696227:0:7623:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.696238:0:7623:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463140.696246:0:7623:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463140.696253:0:7623:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463140.696284:0:7623:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.696292:0:7623:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463140.696331:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.696339:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee35854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3fe72277ee3585b expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.696357:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463140.696359:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463140.696361:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463140.696425:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408064384:0@lo:103: 00000100:00100000:0.0:1788463140.696473:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463140.696579:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408064384 00000100:00100000:1.0:1788463140.696585:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408064384 00000100:00100000:1.0:1788463140.696633:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463140.696642:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:3276:x1875339408064384:12345-0@lo:103: 00010000:00010000:1.0:1788463140.696656:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463140.696718:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0030800/0xc3fe72277ee3585b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee35854 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.696744:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463140.696776:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+12:3276:x1875339408064384:12345-0@lo:103: Request processed in 135us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463140.696782:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463140.696854:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408064384:0@lo:103: 00000040:00080000:2.0:1788463140.696993:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788463140.697187:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788463140.697225:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788463140.697295:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788463140.697333:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788463140.697367:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788463140.697402:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064512:0@lo:502: 00000100:00100000:2.0:1788463140.697454:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.697533:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c58ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463140.697613:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408064512 00000100:00100000:0.0:1788463140.697619:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408064512 00000100:00100000:0.0:1788463140.697675:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788463140.697720:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+12:7617:x1875339408064512:12345-0@lo:502: 00000100:00100000:0.0:1788463140.697937:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+12:7617:x1875339408064512:12345-0@lo:502: Request processed in 252us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.697944:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788463140.698114:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064512:0@lo:502: 00000040:00080000:2.0:1788463140.698228:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788463140.698240:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788463140.699137:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788463140.699149:0:7626:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788463140.699156:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463140.699159:0:7626:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788463140.699166:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463140.699199:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ba5fe6919c0) 00000020:00000080:2.0:1788463140.699231:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788463140.699237:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788463140.699307:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba4c5230000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788463140.699317:0:7626:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788463140.699326:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3fe72277ee35877 00010000:00010000:2.0:1788463140.703908:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788463140.704415:0:7626:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788463140.707626:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788463140.708256:0:7626:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788463140.710768:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788463140.713569:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788463140.714397:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788463140.716310:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788463140.716327:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463140.716336:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463140.716338:0:7626:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788463140.716342:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463140.716346:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463140.716353:0:7626:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788463140.716357:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788463140.716360:0:7626:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788463140.716439:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463140.716443:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463140.716444:0:7626:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788463140.716448:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788463140.720331:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788463140.720397:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788463140.720423:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.720440:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463140.720449:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba4c5230000 from 1 10000000:01000000:0.0:1788463140.720452:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788463140.720512:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.720522:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.720535:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463140.720586:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064640:0@lo:101: 00000100:00100000:0.0:1788463140.720749:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.720796:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463140.720829:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408064640 00000100:00100000:0.0:1788463140.720837:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408064640 00000100:00100000:0.0:1788463140.720892:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788463140.720903:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+12:7617:x1875339408064640:12345-0@lo:101: 00010000:00010000:0.0:1788463140.720919:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463140.720936:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0031a00/0xc3fe72277ee35885 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee3587e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.720966:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0031a00/0xc3fe72277ee35885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee3587e expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.720978:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0031a00/0xc3fe72277ee35885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3587e expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.720988:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0031a00, rc 0) 00000100:00100000:0.0:1788463140.721102:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064640:12345-0@lo:101: Request processed in 200us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.721109:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788463140.721172:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064640:0@lo:101: 00010000:00010000:0.0:1788463140.721190:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.721200:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463140.721335:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064768:0@lo:501: 00000100:00100000:0.0:1788463140.721363:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.721431:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29eeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463140.722864:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408064768 00000100:00100000:3.0:1788463140.722877:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408064768 00000100:00100000:3.0:1788463140.722982:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788463140.722994:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064768:12345-0@lo:501: 00000100:00100000:3.0:1788463140.723390:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064768:12345-0@lo:501: Request processed in 398us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463140.723399:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788463140.723494:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064768:0@lo:501: 00000100:00100000:1.0:1788463140.723553:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064896:0@lo:503: 00000100:00100000:1.0:1788463140.723608:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463140.728159:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec148a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463140.728259:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408064896 00000100:00100000:0.0:1788463140.728271:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408064896 00000100:00100000:0.0:1788463140.728382:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788463140.728393:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064896:12345-0@lo:503: 00000100:00100000:0.0:1788463140.728927:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408064896:12345-0@lo:503: Request processed in 534us (5316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.728937:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788463140.729149:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408064896:0@lo:503: 00000040:00080000:0.0:1788463140.729576:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788463140.729807:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065024:0@lo:502: 00000100:00100000:0.0:1788463140.729871:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.729997:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee900 going to sleep for 11 seconds 00000100:00100000:1.0:1788463140.730105:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408065024 00000100:00100000:1.0:1788463140.730114:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408065024 00000100:00100000:1.0:1788463140.730156:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788463140.730167:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408065024:12345-0@lo:502: 00000100:00100000:1.0:1788463140.730414:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408065024:12345-0@lo:502: Request processed in 249us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463140.730422:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788463140.730530:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065024:0@lo:502: 00000040:00080000:2.0:1788463140.730864:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788463140.730926:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788463140.730962:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065152:0@lo:502: 00000100:00100000:2.0:1788463140.731082:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.731107:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c58f3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463140.731187:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408065152 00000100:00100000:1.0:1788463140.731193:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408065152 00000100:00100000:1.0:1788463140.731228:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788463140.731237:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408065152:12345-0@lo:502: 00000100:00100000:1.0:1788463140.731439:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408065152:12345-0@lo:502: Request processed in 203us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463140.731448:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788463140.731602:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065152:0@lo:502: 00000040:00080000:2.0:1788463140.731854:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788463140.731866:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788463140.732570:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463140.732585:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463140.732587:0:7630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788463140.732596:0:7630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba4c5230000 00000020:00000080:3.0:1788463140.732599:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788463140.732625:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463140.732628:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463140.732629:0:7630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788463140.732632:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788463140.733134:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788463140.733163:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463140.733222:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.733238:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463140.733294:0:7617:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788463140.733298:0:7617:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ba4c5230000 10000000:01000000:2.0:1788463140.733302:0:7617:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ba4c5230000 10000000:01000000:2.0:1788463140.733316:0:7617:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463140.733324:0:7617:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba4c5230000 from 1 10000000:01000000:2.0:1788463140.733327:0:7617:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463140.733371:0:7617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.733380:0:7617:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.733394:0:7617:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463140.733417:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065280:0@lo:101: 00000100:00100000:2.0:1788463140.733496:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.733593:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c58f3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788463140.733849:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408065280 00000100:00100000:1.0:1788463140.733858:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408065280 00000100:00100000:1.0:1788463140.733942:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788463140.733961:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408065280:12345-0@lo:101: 00010000:00010000:1.0:1788463140.733978:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463140.733995:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee3588c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.734097:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee3588c expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.734111:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3588c expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.734122:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489800, rc 0) 00000100:00100000:1.0:1788463140.734186:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7617:x1875339408065280:12345-0@lo:101: Request processed in 226us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463140.734192:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788463140.734274:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065280:0@lo:101: 00010000:00010000:2.0:1788463140.734293:0:7617:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.734304:0:7617:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463140.734422:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065408:0@lo:501: 00000100:00100000:2.0:1788463140.734454:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.734546:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c58f3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788463140.734622:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408065408 00000100:00100000:3.0:1788463140.734627:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408065408 00000100:00100000:3.0:1788463140.734653:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788463140.734671:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7617:x1875339408065408:12345-0@lo:501: 00000100:00100000:3.0:1788463140.735121:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7617:x1875339408065408:12345-0@lo:501: Request processed in 458us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463140.735130:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788463140.735281:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065408:0@lo:501: 00000100:00100000:2.0:1788463140.735324:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065536:0@lo:503: 00000100:00100000:2.0:1788463140.735372:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.735404:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c58f3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788463140.735452:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408065536 00000100:00100000:3.0:1788463140.735463:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408065536 00000100:00100000:3.0:1788463140.735489:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788463140.735496:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7617:x1875339408065536:12345-0@lo:503: 00000100:00100000:3.0:1788463140.735705:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7617:x1875339408065536:12345-0@lo:503: Request processed in 188us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463140.735712:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463140.735788:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065536:0@lo:503: 00000040:00080000:2.0:1788463140.736186:0:7617:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463140.736267:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065664:0@lo:502: 00000100:00100000:2.0:1788463140.736324:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.736349:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c58f3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788463140.736405:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408065664 00000100:00100000:3.0:1788463140.736410:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408065664 00000100:00100000:3.0:1788463140.736438:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788463140.736446:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7617:x1875339408065664:12345-0@lo:502: 00000100:00100000:3.0:1788463140.736675:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7617:x1875339408065664:12345-0@lo:502: Request processed in 229us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463140.736708:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788463140.736793:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065664:0@lo:502: 00000040:00080000:2.0:1788463140.737195:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788463140.737248:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788463140.737283:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788463140.737329:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788463140.737365:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788463140.737416:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788463140.737466:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788463140.737498:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788463140.737553:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788463140.737590:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788463140.737623:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788463140.737680:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788463140.737758:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788463140.737789:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788463140.737833:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788463140.737866:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788463140.737899:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788463140.737958:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788463140.737997:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788463140.738174:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788463140.738229:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788463140.738265:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788463140.738318:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788463140.738367:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788463140.738416:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788463140.738451:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788463140.738510:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788463140.738546:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788463140.738579:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788463140.738629:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788463140.738679:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788463140.738760:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788463140.738791:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788463140.738835:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788463140.738871:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788463140.738937:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788463140.738975:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788463140.739383:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065792:0@lo:502: 00000100:00100000:2.0:1788463140.739483:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.739565:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c58f3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463140.739673:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408065792 00000100:00100000:0.0:1788463140.739770:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408065792 00000100:00100000:3.0:1788463140.739910:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788463140.740076:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7617:x1875339408065792:12345-0@lo:502: 00000100:00100000:2.0:1788463140.740433:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7617:x1875339408065792:12345-0@lo:502: Request processed in 510us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.740442:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788463140.740580:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408065792:0@lo:502: 00000040:00080000:0.0:1788463140.740894:0:7617:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788463140.740912:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788463140.741638:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788463140.741671:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ba5fe694d40) 00000020:00000080:2.0:1788463140.741727:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788463140.741815:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba4c5230000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788463140.741820:0:7631:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ba4c5230000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788463140.741823:0:7631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba4c5230000 3 00010000:00080000:2.0:1788463140.741861:0:7631:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ba5efad0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.111@tcp at head 00010000:00010000:2.0:1788463140.744537:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788463140.745263:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788463140.745321:0:7631:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788463140.745346:0:7631:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc3fe72277ee358a1 00000100:00080000:2.0:1788463140.745362:0:7631:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463140.745369:0:7631:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ba5efad0800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1788463140.745425:0:7631:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5fee4c700 x1875339408065920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463140.745456:0:7631:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788463140.745820:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875339408065920:0@lo:38: 00000100:00100000:3.0:1788463140.745918:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.746133:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408065920 00000100:00100000:2.0:1788463140.746146:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408065920 00000100:00100000:2.0:1788463140.746192:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463140.746202:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3275:x1875339408065920:12345-0@lo:38: 00010000:00080000:2.0:1788463140.746236:0:5818:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:2.0:1788463140.746278:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc3fe72277ee358a8 00000004:00100000:2.0:1788463140.746299:0:5818:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788463140.746341:0:5818:0:(import.c:65:import_set_state_nolock()) ffff9ba5f7f75800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463140.746423:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875339408065920:12345-0@lo:38: Request processed in 220us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463140.746431:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1788463140.746637:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1788463140.746858:0:7632:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9ba5fee4f800 x1875339408066048/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463140.746869:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c58f3780 going to sleep for 0 seconds 00010000:00080000:3.0:1788463140.746968:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee4c700 x1875339408065920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463140.746980:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788463140.746989:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788463140.746998:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788463140.747003:0:3275:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788463140.747006:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5efad0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788463140.747080:0:3275:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009b9a6d21): req@ffff9ba5fee4f800 x1875339408066048/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463140.747103:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875339408065920:0@lo:38: 00000100:00100000:2.0:1788463140.748222:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.748261:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c58f3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788463140.748366:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408066048 00000100:00100000:3.0:1788463140.748375:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408066048 00000100:00100000:3.0:1788463140.748455:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463140.748468:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7632:x1875339408066048:12345-0@lo:901: 00010000:00080000:2.0:1788463140.749156:0:7632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee4f800 x1875339408066048/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788463156 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463140.749170:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4f800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7632:1875339408066048:0@lo:901: 00000100:00100000:3.0:1788463140.749468:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7632:x1875339408066048:12345-0@lo:901: Request processed in 542us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463140.749480:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1788463140.749623:0:7617:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788463140.749673:0:7617:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788463140.749718:0:7617:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463140.749732:0:7617:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788463140.749799:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788463140.749801:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788463140.749803:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463140.749804:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463140.749806:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463140.749807:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463140.749809:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463140.749811:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788463140.749818:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788463140.749819:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463140.749820:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463140.749826:0:7617:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788463140.749828:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788463140.749830:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788463140.749831:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463140.749832:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463140.749833:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463140.749834:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463140.749835:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463140.749836:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788463140.749836:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788463140.749837:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463140.749838:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463140.749874:0:7617:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788463140.749895:0:7617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408066176:0@lo:253: 00000100:00100000:1.0:1788463140.749963:0:7617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463140.750002:0:7617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec148c00 going to sleep for 11 seconds 00000100:00080000:0.0:1788463140.751733:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463140.755216:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408066176 00000100:00100000:3.0:1788463140.755239:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408066176 00000100:00100000:3.0:1788463140.755342:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788463140.755356:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7617:x1875339408066176:12345-0@lo:253: 20000000:01000000:3.0:1788463140.755410:0:5809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788463140.755429:0:5809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788463140.784633:0:5809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788463140.784667:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788463140.784798:0:5832:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788463140.784828:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788463140.784863:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.784888:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35831 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.784898:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.784955:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35831 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463140.784974:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35831 expref: 14 pid: 5809 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463140.784994:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1875339408066304:0@lo:104: 00000100:00100000:2.0:1788463140.785099:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463140.785163:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7d40b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463140.785531:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408066304 00000100:00100000:0.0:1788463140.785543:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408066304 00000100:00100000:0.0:1788463140.785618:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463140.785630:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5832:x1875339408066304:12345-0@lo:104: 00010000:00010000:0.0:1788463140.785675:0:6681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.785764:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463140.785770:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+3:5832:x1875339408066304:12345-0@lo:104: Request processed in 144us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.785778:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788463140.785823:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463140.785830:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.785838:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8ca800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1788463140.785843:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.785853:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463140.785861:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463140.785867:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788463140.785904:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.785912:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463140.785934:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.785942:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca800/0xc3fe72277ee35831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35838 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.785971:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463140.785973:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463140.785975:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463140.785997:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408066432:0@lo:103: 00000100:00100000:3.0:1788463140.786136:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5832:1875339408066304:0@lo:104: 00010000:00010000:3.0:1788463140.786169:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463140.786252:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463140.786301:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408066432 00000100:00100000:0.0:1788463140.786306:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408066432 00010000:00010000:0.0:1788463140.786330:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35831 expref: 15 pid: 5809 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463140.786358:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788463140.786365:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c8991450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:3277:x1875339408066432:12345-0@lo:103: 00010000:00010000:0.0:1788463140.786378:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463140.786384:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35838 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35831 expref: 15 pid: 5809 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.786397:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35831 expref: 15 pid: 5809 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.786412:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35831 expref: 15 pid: 5809 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.786425:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.786435:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788463140.786453:0:5804:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010926612s 00010000:00010000:0.0:1788463140.786469:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.786476:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.786483:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.786489:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.786494:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cb600 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463140.786498:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.786507:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463140.787740:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463140.787760:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.787845:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.787856:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee358af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463140.787879:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463140.788412:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c8991450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:3277:x1875339408066432:12345-0@lo:103: Request processed in 2044us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.788425:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463140.788785:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408066432:0@lo:103: 00000100:00100000:0.0:1788463140.796864:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:7617:x1875339408066176:12345-0@lo:253: Request processed in 41499us (46888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463140.796885:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788463140.797007:0:7617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:777dc377-0af3-4f9e-a02c-a691119a7ded:7617:1875339408066176:0@lo:253: 10000000:01000000:1.0:1788463140.797094:0:7617:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788463140.797098:0:7617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788463140.797101:0:7617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788463140.797103:0:7617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463140.797104:0:7617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463140.797106:0:7617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463140.797108:0:7617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463140.797110:0:7617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463140.797111:0:7617:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788463140.797113:0:7617:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788463140.797115:0:7617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463140.797116:0:7617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788463140.797135:0:7617:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788463140.802562:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788463140.802824:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788463140.803048:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788463140.803235:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788463140.803454:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788463140.803810:0:7617:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788463140.805986:0:7617:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788463141.220078:0:7617:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788463141.220090:0:7617:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788463141.220134:0:7617:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788463141.220218:0:7617:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788463141.220238:0:7617:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788463141.220283:0:7617:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788463141.740676:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463142.759480:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463143.783842:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463144.805213:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463145.508969:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463145.509005:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408066560:0@lo:13: 00000100:00100000:0.0:1788463145.509091:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463145.509201:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408066560 00000100:00100000:2.0:1788463145.509210:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408066560 00000100:00100000:2.0:1788463145.509351:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463145.509365:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408066560:12345-0@lo:13: 00002000:00000024:2.0:1788463145.509405:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463145.509457:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408066560:12345-0@lo:13: Request processed in 95us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463145.509464:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788463145.509506:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee4ed80 x1875339408066560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463145.509525:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408066560:0@lo:13: 00000100:00080000:0.0:1788463145.509671:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463145.828944:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463146.021023:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408066688:0@lo:400: 00000100:00100000:1.0:1788463146.021104:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.021158:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463146.021178:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408067072:0@lo:400: 00000100:00100000:1.0:1788463146.021213:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.021248:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408066816:0@lo:400: 00000100:00100000:1.0:1788463146.021272:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.021292:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463146.021297:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408066944:0@lo:400: 00000100:00100000:1.0:1788463146.021317:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.021348:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408066688 00000100:00100000:1.0:1788463146.021356:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408066688 00000100:00100000:1.0:1788463146.021403:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788463146.021413:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:3279:x1875339408066688:12345-0@lo:400: 00000100:00100000:1.0:1788463146.021465:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:3279:x1875339408066688:12345-0@lo:400: Request processed in 52us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.021472:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788463146.021504:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408067072 00000100:00100000:1.0:1788463146.021508:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408067072 00000100:00100000:1.0:1788463146.021539:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408066816 00000100:00100000:1.0:1788463146.021542:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408066816 00000100:00100000:1.0:1788463146.021552:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408066944 00000100:00100000:1.0:1788463146.021554:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408066944 00000100:00100000:1.0:1788463146.021599:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463146.021605:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408067072:12345-0@lo:400: 00000100:00100000:1.0:1788463146.021638:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408067072:12345-0@lo:400: Request processed in 33us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.021644:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463146.021655:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463146.021660:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408066816:12345-0@lo:400: 00000100:00100000:1.0:1788463146.021713:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408066816:12345-0@lo:400: Request processed in 53us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.021719:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463146.021731:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463146.021737:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408066944:12345-0@lo:400: 00000100:00100000:1.0:1788463146.021762:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408066944:12345-0@lo:400: Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.021767:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788463146.021793:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788463146.021822:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f795a300 x1875339408066944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463146.021838:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408066944:0@lo:400: 00010000:00080000:1.0:1788463146.021849:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f7958000 x1875339408066816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463146.021857:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408066816:0@lo:400: 00010000:00080000:1.0:1788463146.021886:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f7959180 x1875339408067072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463146.021895:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408067072:0@lo:400: 00000100:00100000:1.0:1788463146.021912:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408066688:0@lo:400: 10000000:01000000:0.0:1788463146.532764:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788463146.532772:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba5c2e32800 from 30 10000000:01000000:0.0:1788463146.532778:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788463146.532821:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463146.532834:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463146.532846:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463146.532871:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408067200:0@lo:101: 00000100:00100000:0.0:1788463146.532944:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463146.532995:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.536506:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408067200 00000100:00100000:3.0:1788463146.536524:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408067200 00000100:00100000:3.0:1788463146.536601:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788463146.536612:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408067200:12345-0@lo:101: 00010000:00010000:3.0:1788463146.536629:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463146.536648:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee358bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee358b6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.536679:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee358bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee358b6 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.536708:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee358bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee358b6 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.536718:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e703a600, rc 0) 00000100:00100000:3.0:1788463146.536803:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408067200:12345-0@lo:101: Request processed in 193us (3859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.536810:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788463146.536860:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408067200:0@lo:101: 00010000:00010000:2.0:1788463146.536880:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463146.536890:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463146.537182:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408067328:0@lo:501: 00000100:00100000:3.0:1788463146.537290:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463146.537328:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c2ed86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.537345:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408067328 00000100:00100000:3.0:1788463146.537351:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408067328 00000100:00100000:3.0:1788463146.537385:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788463146.537394:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408067328:12345-0@lo:501: 00000100:00100000:3.0:1788463146.537812:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408067328:12345-0@lo:501: Request processed in 418us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.537819:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788463146.537849:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408067328:0@lo:501: 00000100:00100000:3.0:1788463146.537875:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408067456:0@lo:503: 00000100:00100000:3.0:1788463146.537916:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463146.537935:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c2ed86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.537947:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408067456 00000100:00100000:3.0:1788463146.537951:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408067456 00000100:00100000:3.0:1788463146.537971:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788463146.537978:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408067456:12345-0@lo:503: 00000100:00100000:3.0:1788463146.540033:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408067456:12345-0@lo:503: Request processed in 2047us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.540046:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788463146.543350:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408067456:0@lo:503: 00000100:00100000:1.0:1788463146.544651:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7859:1875339408067584:0@lo:502: 00000100:00100000:1.0:1788463146.544755:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.544800:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec066300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463146.545351:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408067584 00000100:00100000:2.0:1788463146.545361:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408067584 00000100:00100000:2.0:1788463146.545418:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788463146.545427:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7859:x1875339408067584:12345-0@lo:502: 00000100:00100000:2.0:1788463146.545836:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7859:x1875339408067584:12345-0@lo:502: Request processed in 408us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463146.545845:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788463146.545910:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7859:1875339408067584:0@lo:502: 00000100:00100000:2.0:1788463146.545971:0:7859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7859:1875339408067712:0@lo:502: 00000100:00100000:2.0:1788463146.546011:0:7859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463146.546039:0:7859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.546117:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408067712 00000100:00100000:3.0:1788463146.546122:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408067712 00000100:00100000:3.0:1788463146.546155:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788463146.546164:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7859:x1875339408067712:12345-0@lo:502: 00000100:00100000:3.0:1788463146.546545:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:7859:x1875339408067712:12345-0@lo:502: Request processed in 381us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.546564:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788463146.546633:0:7859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7859:1875339408067712:0@lo:502: 00000040:00080000:1.0:1788463146.546655:0:7859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788463146.550456:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788463146.550488:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788463146.550503:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.550518:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463146.550531:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788463146.550533:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1788463146.550536:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788463146.550629:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.550645:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.550656:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463146.550678:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408067840:0@lo:101: 00000100:00100000:3.0:1788463146.550840:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463146.550925:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c2ed8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463146.550962:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408067840 00000100:00100000:2.0:1788463146.550969:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408067840 00000100:00100000:2.0:1788463146.551052:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788463146.551062:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408067840:12345-0@lo:101: 00010000:00010000:2.0:1788463146.551077:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463146.551090:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee358cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee358c4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463146.551127:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee358cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee358c4 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463146.551137:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee358cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee358c4 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463146.551145:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cb400, rc 0) 00000100:00100000:2.0:1788463146.551269:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408067840:12345-0@lo:101: Request processed in 208us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463146.551277:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788463146.551359:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408067840:0@lo:101: 00010000:00010000:1.0:1788463146.551379:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.551389:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463146.551457:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408067968:0@lo:501: 00000100:00100000:1.0:1788463146.551488:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.551593:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec066d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.551635:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408067968 00000100:00100000:3.0:1788463146.551640:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408067968 00000100:00100000:3.0:1788463146.551661:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788463146.551667:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408067968:12345-0@lo:501: 00000100:00100000:3.0:1788463146.551956:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408067968:12345-0@lo:501: Request processed in 287us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.551964:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788463146.552053:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408067968:0@lo:501: 00000100:00100000:1.0:1788463146.552084:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408068096:0@lo:503: 00000100:00100000:1.0:1788463146.552124:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.552152:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec066d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.552200:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408068096 00000100:00100000:3.0:1788463146.552204:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408068096 00000100:00100000:3.0:1788463146.552225:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788463146.552231:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408068096:12345-0@lo:503: 00000100:00100000:3.0:1788463146.552526:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408068096:12345-0@lo:503: Request processed in 294us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.552533:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788463146.552675:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408068096:0@lo:503: 00000100:00100000:1.0:1788463146.553279:0:7860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7860:1875339408068224:0@lo:502: 00000100:00100000:1.0:1788463146.553318:0:7860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.553384:0:7860:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec066600 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.553450:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408068224 00000100:00100000:3.0:1788463146.553455:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408068224 00000100:00100000:3.0:1788463146.553519:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788463146.553528:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:7860:x1875339408068224:12345-0@lo:502: 00000100:00100000:3.0:1788463146.553767:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:7860:x1875339408068224:12345-0@lo:502: Request processed in 240us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.553774:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788463146.553865:0:7860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7860:1875339408068224:0@lo:502: 00000020:01000000:2.0:1788463146.553889:0:7860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463146.553898:0:7860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463146.553900:0:7860:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788463146.553906:0:7860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788463146.553908:0:7860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788463146.553926:0:7860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7860:1875339408068352:0@lo:502: 00000100:00100000:2.0:1788463146.553961:0:7860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.554101:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408068352 00000100:00100000:1.0:1788463146.554107:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408068352 00000100:00100000:1.0:1788463146.554132:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788463146.554139:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:7860:x1875339408068352:12345-0@lo:502: 00000100:00100000:1.0:1788463146.554287:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:7860:x1875339408068352:12345-0@lo:502: Request processed in 148us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.554294:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788463146.554453:0:7860:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463146.554467:0:7860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7860:1875339408068352:0@lo:502: 00000020:01000000:2.0:1788463146.554485:0:7860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463146.554489:0:7860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463146.554490:0:7860:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788463146.554494:0:7860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788463146.554673:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788463146.554930:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788463146.554942:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.554952:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463146.554964:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788463146.554966:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba5c88d5800 from 30 10000000:01000000:3.0:1788463146.554969:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788463146.554996:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.555005:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.555015:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463146.555029:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408068480:0@lo:101: 00000100:00100000:3.0:1788463146.555061:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463146.555084:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c2ed8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.555098:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408068480 00000100:00100000:3.0:1788463146.555101:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408068480 00000100:00100000:3.0:1788463146.555342:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788463146.555351:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408068480:12345-0@lo:101: 00010000:00010000:3.0:1788463146.555367:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463146.555391:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b1a00/0xc3fe72277ee358d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee358d2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.555416:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b1a00/0xc3fe72277ee358d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee358d2 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.555425:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b1a00/0xc3fe72277ee358d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee358d2 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.555434:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1a00, rc 0) 00000100:00100000:3.0:1788463146.555508:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408068480:12345-0@lo:101: Request processed in 158us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.555515:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788463146.555590:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408068480:0@lo:101: 00010000:00010000:1.0:1788463146.555605:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.555613:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463146.555658:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408068608:0@lo:501: 00000100:00100000:1.0:1788463146.555746:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.555795:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec066240 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.555834:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408068608 00000100:00100000:3.0:1788463146.555839:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408068608 00000100:00100000:3.0:1788463146.555862:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788463146.555869:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408068608:12345-0@lo:501: 00000100:00100000:3.0:1788463146.556109:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408068608:12345-0@lo:501: Request processed in 240us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.556116:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788463146.557488:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408068608:0@lo:501: 00000100:00100000:0.0:1788463146.557573:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408068736:0@lo:503: 00000100:00100000:0.0:1788463146.557650:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463146.557717:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463146.558350:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408068736 00000100:00100000:1.0:1788463146.558359:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408068736 00000100:00100000:1.0:1788463146.558425:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788463146.558437:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408068736:12345-0@lo:503: 00000100:00100000:1.0:1788463146.558680:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408068736:12345-0@lo:503: Request processed in 245us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.558713:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788463146.559575:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408068736:0@lo:503: 00000100:00100000:0.0:1788463146.562294:0:7861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7861:1875339408068864:0@lo:502: 00000100:00100000:0.0:1788463146.562386:0:7861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463146.562457:0:7861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463146.562493:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408068864 00000100:00100000:1.0:1788463146.562502:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408068864 00000100:00100000:1.0:1788463146.562587:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788463146.562597:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:7861:x1875339408068864:12345-0@lo:502: 00000100:00100000:1.0:1788463146.562881:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:7861:x1875339408068864:12345-0@lo:502: Request processed in 286us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.562890:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788463146.562974:0:7861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7861:1875339408068864:0@lo:502: 00000100:00100000:2.0:1788463146.563033:0:7861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7861:1875339408068992:0@lo:502: 00000100:00100000:2.0:1788463146.563079:0:7861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463146.563311:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408068992 00000100:00100000:0.0:1788463146.563316:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408068992 00000100:00100000:0.0:1788463146.563340:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788463146.563347:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:7861:x1875339408068992:12345-0@lo:502: 00000100:00100000:0.0:1788463146.563485:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:7861:x1875339408068992:12345-0@lo:502: Request processed in 138us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463146.563491:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788463146.563589:0:7861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463146.563606:0:7861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7861:1875339408068992:0@lo:502: 00000040:00080000:2.0:1788463146.563627:0:7861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788463146.563925:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788463146.563946:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788463146.563957:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.563968:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463146.563977:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788463146.563980:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ba5c88d5800 from 5 10000000:01000000:1.0:1788463146.563983:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788463146.564014:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.564022:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.564031:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463146.564044:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408069120:0@lo:101: 00000100:00100000:1.0:1788463146.564077:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.564147:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec066000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463146.564180:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408069120 00000100:00100000:0.0:1788463146.564184:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408069120 00000100:00100000:0.0:1788463146.564322:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788463146.564331:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408069120:12345-0@lo:101: 00010000:00010000:0.0:1788463146.564341:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463146.564355:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0030a00/0xc3fe72277ee358e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee358e0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463146.564380:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0030a00/0xc3fe72277ee358e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee358e0 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463146.564393:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0030a00/0xc3fe72277ee358e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee358e0 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463146.564404:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0030a00, rc 0) 00000100:00100000:0.0:1788463146.564501:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408069120:12345-0@lo:101: Request processed in 171us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463146.564507:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788463146.564572:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408069120:0@lo:101: 00010000:00010000:2.0:1788463146.564587:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463146.564598:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463146.564647:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408069248:0@lo:256: 00000100:00100000:2.0:1788463146.564707:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463146.564845:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463146.564895:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408069248 00000100:00100000:1.0:1788463146.564901:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408069248 00000100:00100000:1.0:1788463146.564925:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788463146.564931:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408069248:12345-0@lo:256: 20000000:01000000:1.0:1788463146.564955:0:5811:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788463146.564975:0:5811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788463146.564978:0:5811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788463146.565062:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408069248:12345-0@lo:256: Request processed in 130us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.565070:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788463146.565153:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408069248:0@lo:256: 10000000:01000000:2.0:1788463146.565283:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788463146.565291:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463146.565299:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463146.565307:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788463146.565310:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788463146.565312:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788463146.565332:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463146.565353:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463146.565361:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463146.565373:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408069376:0@lo:101: 00000100:00100000:2.0:1788463146.565402:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463146.565467:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463146.565499:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408069376 00000100:00100000:1.0:1788463146.565504:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408069376 00000100:00100000:1.0:1788463146.565571:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788463146.565578:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408069376:12345-0@lo:101: 00010000:00010000:1.0:1788463146.565587:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463146.565599:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c1488a00/0xc3fe72277ee358f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee358ee expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.565615:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1488a00/0xc3fe72277ee358f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee358ee expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.565624:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c1488a00/0xc3fe72277ee358f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee358ee expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.565630:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488a00, rc 0) 00000100:00100000:1.0:1788463146.565667:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408069376:12345-0@lo:101: Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.565673:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788463146.565780:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408069376:0@lo:101: 00010000:00010000:2.0:1788463146.565791:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463146.565800:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463146.565844:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408069504:0@lo:501: 00000100:00100000:2.0:1788463146.565870:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463146.565985:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463146.566019:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408069504 00000100:00100000:0.0:1788463146.566023:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408069504 00000100:00100000:0.0:1788463146.566043:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788463146.566050:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408069504:12345-0@lo:501: 00000100:00100000:0.0:1788463146.566387:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408069504:12345-0@lo:501: Request processed in 337us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463146.566394:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788463146.568938:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408069504:0@lo:501: 00000100:00100000:3.0:1788463146.569411:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408069632:0@lo:503: 00000100:00100000:3.0:1788463146.569493:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463146.569565:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c1086000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463146.570283:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408069632 00000100:00100000:2.0:1788463146.570295:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408069632 00000100:00100000:2.0:1788463146.570491:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788463146.570502:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408069632:12345-0@lo:503: 00000100:00100000:2.0:1788463146.571278:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408069632:12345-0@lo:503: Request processed in 776us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463146.571288:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788463146.571703:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408069632:0@lo:503: 00000100:00100000:2.0:1788463146.580405:0:7866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7866:1875339408069760:0@lo:502: 00000100:00100000:2.0:1788463146.580508:0:7866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463146.580608:0:7866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463146.583384:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408069760 00000100:00100000:1.0:1788463146.583401:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408069760 00000100:00100000:1.0:1788463146.583603:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788463146.583615:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:7866:x1875339408069760:12345-0@lo:502: 00000100:00100000:1.0:1788463146.584121:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:7866:x1875339408069760:12345-0@lo:502: Request processed in 506us (3611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.584135:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788463146.584233:0:7866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7866:1875339408069760:0@lo:502: 00000020:01000000:0.0:1788463146.584271:0:7866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788463146.584280:0:7866:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788463146.584288:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463146.584291:0:7866:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788463146.584296:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788463146.584300:0:7866:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:0.0:1788463146.584327:0:7866:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788463146.584331:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788463146.584348:0:7866:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ba4c54a8000) 00000020:00000080:0.0:1788463146.584374:0:7866:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788463146.584380:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788463146.584467:0:7866:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788463146.584473:0:7866:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788463146.584482:0:7866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee35903 00010000:00080000:0.0:1788463146.584513:0:7866:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ba5ec715000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1788463146.584790:0:7866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788463146.585144:0:7866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788463146.585158:0:7866:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788463146.585765:0:7866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463146.585993:0:7866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788463146.586046:0:7866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788463146.586107:0:7866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788463146.586773:0:7868:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463146.586779:0:7868:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788463146.589396:0:7866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788463146.589416:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788463146.589462:0:7866:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788463146.589495:0:7866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3fe72277ee3590a 00000100:00080000:0.0:1788463146.589509:0:7866:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463146.589519:0:7866:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ba5ec715000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463146.589578:0:7866:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5ec8f0000 x1875339408069888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463146.589612:0:7866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788463146.589800:0:7866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463146.589806:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463146.589807:0:7866:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788463146.589811:0:7866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463146.589816:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463146.589817:0:7866:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463146.589820:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463146.589823:0:7866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788463146.589844:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408069888:0@lo:8: 00000100:00100000:0.0:1788463146.589851:0:7866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7866:1875339408070016:0@lo:502: 00000100:00100000:1.0:1788463146.590103:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408070144:0@lo:400: 00000100:00100000:3.0:1788463146.592790:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463146.592901:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408069888 00000100:00100000:3.0:1788463146.592924:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408069888 00000100:00100000:3.0:1788463146.592971:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463146.592980:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3275:x1875339408069888:12345-0@lo:8: 00010000:00080000:3.0:1788463146.593858:0:6667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1788463146.593891:0:6667:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3fe72277ee35911 00002000:00100000:3.0:1788463146.594123:0:6667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ba5ec407800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788463146.594130:0:6667:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788463146.594135:0:6667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788463146.594283:0:6667:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788463146.594477:0:6667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788463146.594506:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec401000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463146.594606:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3275:x1875339408069888:12345-0@lo:8: Request processed in 1625us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.594615:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788463146.594673:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec8f0000 x1875339408069888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463146.594697:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788463146.594707:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788463146.594715:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788463146.594721:0:3275:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788463146.594724:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec715000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788463146.594737:0:3275:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788463146.594742:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408069888:0@lo:8: 00000004:00080000:3.0:1788463146.594770:0:7868:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788463146.594879:0:7868:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 178205194448ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788463146.598057:0:7866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463146.599539:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408070016 00000100:00100000:3.0:1788463146.599566:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408070016 00000100:00100000:0.0:1788463146.599628:0:7866:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.599631:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788463146.599641:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:7866:x1875339408070016:12345-0@lo:502: 00000100:00100000:3.0:1788463146.600283:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:7866:x1875339408070016:12345-0@lo:502: Request processed in 642us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.600292:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788463146.600413:0:7866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:7866:1875339408070016:0@lo:502: 00000020:01000000:2.0:1788463146.600454:0:7866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463146.600462:0:7866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463146.600465:0:7866:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788463146.600470:0:7866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788463146.600643:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788463146.600668:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788463146.600681:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463146.600882:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408070400:0@lo:400: 00000100:00100000:2.0:1788463146.600949:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463146.600989:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463146.600999:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408070272:0@lo:400: 00000100:00100000:2.0:1788463146.601034:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463146.601423:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408070272 00000100:00100000:3.0:1788463146.601432:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408070272 00000100:00100000:3.0:1788463146.601479:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463146.601488:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408070272:12345-0@lo:400: 00000100:00100000:3.0:1788463146.601542:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408070272:12345-0@lo:400: Request processed in 54us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.601562:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788463146.601673:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463146.601712:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788463146.601716:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ba5c7d7cd40 from 1 10000000:01000000:0.0:1788463146.601720:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788463146.601761:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463146.601769:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463146.601784:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463146.601802:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408070656:0@lo:101: 00000100:00100000:0.0:1788463146.601843:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.601852:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408070400 00000100:00100000:1.0:1788463146.601859:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408070400 00000100:00100000:0.0:1788463146.601875:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788463146.601899:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463146.601909:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408070400:12345-0@lo:400: 00000100:00100000:1.0:1788463146.602330:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408070400:12345-0@lo:400: Request processed in 422us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.602338:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463146.602705:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408070528:0@lo:400: 00000100:00100000:2.0:1788463146.602749:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788463146.602815:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f7959500 x1875339408070272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463146.602831:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408070272:0@lo:400: 00010000:00080000:2.0:1788463146.602846:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f795a300 x1875339408070400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463146.602855:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408070400:0@lo:400: 00000100:00100000:2.0:1788463146.602907:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463146.603107:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408070528 00000100:00100000:1.0:1788463146.603114:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408070528 00000100:00100000:1.0:1788463146.603152:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408070144 00000100:00100000:1.0:1788463146.603156:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408070144 00000100:00100000:1.0:1788463146.603191:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463146.603200:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408070528:12345-0@lo:400: 00000100:00100000:1.0:1788463146.604730:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408070528:12345-0@lo:400: Request processed in 1524us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.604813:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463146.604860:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463146.604876:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408070144:12345-0@lo:400: 00000100:00100000:1.0:1788463146.605001:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408070144:12345-0@lo:400: Request processed in 133us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.605008:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788463146.605068:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f7958000 x1875339408070528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463146.605086:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408070528:0@lo:400: 00000100:00100000:1.0:1788463146.605140:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408070656 00000100:00100000:1.0:1788463146.605149:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408070656 00000100:00100000:1.0:1788463146.605858:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788463146.605872:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408070656:12345-0@lo:101: 00010000:00010000:1.0:1788463146.605887:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463146.605910:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee3591f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35918 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.605941:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee3591f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35918 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.605954:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee3591f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35918 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463146.605965:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488000, rc 0) 00000100:00100000:1.0:1788463146.606027:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408070656:12345-0@lo:101: Request processed in 158us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463146.606033:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788463146.606272:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408070656:0@lo:101: 00010000:00010000:2.0:1788463146.606307:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463146.606320:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788463146.606335:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f7959f80 x1875339408070144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463146.606349:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408070144:0@lo:400: 00000100:00100000:2.0:1788463146.606418:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408070784:0@lo:501: 00000100:00100000:2.0:1788463146.606458:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463146.606493:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.606597:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408070784 00000100:00100000:3.0:1788463146.606603:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408070784 00000100:00100000:3.0:1788463146.606633:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788463146.606642:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408070784:12345-0@lo:501: 00000100:00100000:3.0:1788463146.606927:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408070784:12345-0@lo:501: Request processed in 284us (467us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463146.606936:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788463146.607003:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408070784:0@lo:501: 10000000:01000000:3.0:1788463146.607050:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788463146.607059:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463146.607083:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463146.649004:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788463146.681835:0:7869:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788463146.681861:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408070912:0@lo:13: 00000100:00100000:0.0:1788463146.681865:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1875339408071040:0@lo:7: 00000100:00100000:0.0:1788463146.683835:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463146.683946:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c4c306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.684059:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408071040 00000100:00100000:3.0:1788463146.684070:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408071040 00000100:00100000:3.0:1788463146.684257:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463146.684269:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7869:x1875339408071040:12345-0@lo:7: 00000100:00100000:2.0:1788463146.684710:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463146.684759:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408070912 00000100:00100000:2.0:1788463146.684764:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408070912 00000100:00100000:2.0:1788463146.684793:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463146.684801:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408070912:12345-0@lo:13: 00002000:00000024:2.0:1788463146.684825:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788463146.684880:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408070912:12345-0@lo:13: Request processed in 79us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463146.684886:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788463146.684936:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec8f3100 x1875339408070912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463146.684961:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408070912:0@lo:13: 00000100:00080000:0.0:1788463146.685005:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788463146.692132:0:6668:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788463146.692142:0:6668:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788463146.692557:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7869:x1875339408071040:12345-0@lo:7: Request processed in 8272us (8709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463146.692569:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788463146.692825:0:7869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec8f1500 x1875339408071040/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788463162 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463146.692844:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1875339408071040:0@lo:7: 00000004:00080000:0.0:1788463146.692862:0:7869:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788463146.692976:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1875339408071168:0@lo:5: 00000100:00100000:0.0:1788463146.693019:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463146.693099:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c4c306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.693136:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408071168 00000100:00100000:3.0:1788463146.693144:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408071168 00000100:00100000:2.0:1788463146.693224:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463146.693236:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7869:x1875339408071168:12345-0@lo:5: 00002000:00080000:2.0:1788463146.693263:0:6665:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788463146.693267:0:6665:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788463146.693744:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7869:x1875339408071168:12345-0@lo:5: Request processed in 510us (723us total) trans 4294967297 rc 0/0 00010000:00080000:0.0:1788463146.693745:0:7869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec8f1500 x1875339408071168/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463162 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463146.693754:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463146.693757:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1875339408071168:0@lo:5: 00000004:00080000:0.0:1788463146.693767:0:7869:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788463146.693796:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1875339408071296:0@lo:700: 00000100:00100000:0.0:1788463146.693823:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463146.693851:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c4c306c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463146.693901:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408071296 00000100:00100000:2.0:1788463146.693906:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408071296 00000100:00100000:2.0:1788463146.693975:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463146.693988:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7869:x1875339408071296:12345-0@lo:700: 00000100:00100000:2.0:1788463146.694019:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6674:1875339408071424:0@lo:700: 00000100:00100000:2.0:1788463146.694052:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463146.694601:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408071424 00000100:00100000:3.0:1788463146.694608:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408071424 00000100:00100000:3.0:1788463146.694644:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463146.694652:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6674:x1875339408071424:12345-0@lo:700: 00000100:00100000:2.0:1788463146.694657:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49b40 going to sleep for 11 seconds 40000000:02000000:2.0:1788463146.731279:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788463146.736225:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6674:x1875339408071424:12345-0@lo:700: Request processed in 41564us (42162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463146.736246:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788463146.736254:0:6674:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee4c380 x1875339408071424/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788463162 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463146.736269:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6674:1875339408071424:0@lo:700: 40000000:02000000:3.0:1788463146.736285:0:6674:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1788463146.812881:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7869:x1875339408071296:12345-0@lo:700: Request processed in 118885us (119047us total) trans 0 rc 0/0 00000001:00080000:1.0:1788463146.812983:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788463146.813009:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1788463146.813009:0:7869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec8f3100 x1875339408071296/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788463162 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463146.813027:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1875339408071296:0@lo:700: 00000100:00100000:3.0:1788463146.813443:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:02000040:0.0:1788463146.848242:0:7869:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788463146.853495:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1875339408071552:0@lo:5: 00000100:00100000:0.0:1788463146.853679:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463146.853796:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c79a3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463146.854271:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408071552 00000100:00100000:3.0:1788463146.854295:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408071552 00010000:00010000:1.0:1788463146.854404:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463146.854667:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463146.854679:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7869:x1875339408071552:12345-0@lo:5: 00002000:00080000:2.0:1788463146.863094:0:6668:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788463146.864081:0:6668:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788463146.870775:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7869:x1875339408071552:12345-0@lo:5: Request processed in 16088us (17086us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788463146.870791:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788463146.870857:0:7869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec8f3100 x1875339408071552/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463162 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463146.870872:0:7869:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788463146.871034:0:7869:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ba5ec8f3100 x1875339408071552/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788463162 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463146.871047:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7869:1875339408071552:0@lo:5: 00000004:00080000:3.0:1788463146.871064:0:7869:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788463147.878919:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788463148.834630:0:7984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788463148.900896:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463149.930596:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463150.629552:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408071680:0@lo:13: 00000100:00100000:2.0:1788463150.629631:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463150.629848:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408071680 00000100:00100000:1.0:1788463150.629857:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408071680 00000100:00100000:1.0:1788463150.629939:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463150.629951:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408071680:12345-0@lo:13: 00002000:00000024:1.0:1788463150.629991:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463150.630040:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408071680:12345-0@lo:13: Request processed in 93us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463150.630048:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788463150.630247:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463150.630286:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f7959f80 x1875339408071680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463150.630307:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408071680:0@lo:13: 00010000:00010000:1.0:1788463150.948907:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463151.653711:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408071936:0@lo:400: 00000100:00100000:1.0:1788463151.653818:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463151.653900:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408072448:0@lo:400: 00000100:00100000:1.0:1788463151.653950:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463151.653990:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463151.653996:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408072064:0@lo:400: 00000100:00100000:1.0:1788463151.654019:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463151.654054:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408072448 00000100:00100000:1.0:1788463151.654061:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408072448 00000100:00100000:1.0:1788463151.654126:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408072064 00000100:00100000:1.0:1788463151.654129:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408072064 00000100:00100000:1.0:1788463151.654147:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463151.654156:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1875339408072448:12345-0@lo:400: 00000100:00100000:1.0:1788463151.654212:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3278:x1875339408072448:12345-0@lo:400: Request processed in 56us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463151.654219:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463151.654236:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463151.654241:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408072064:12345-0@lo:400: 00000100:00100000:1.0:1788463151.654267:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7958a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408072064:12345-0@lo:400: Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463151.654284:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788463151.654320:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4bea680 x1875339408072064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463151.654333:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408072064:0@lo:400: 00010000:00080000:1.0:1788463151.654342:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5edc70a80 x1875339408072448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463151.654351:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408072448:0@lo:400: 00000100:00100000:3.0:1788463151.654722:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408071936 00000100:00100000:3.0:1788463151.654728:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408071936 00000100:00100000:3.0:1788463151.654761:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463151.654768:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408071936:12345-0@lo:400: 00000100:00100000:3.0:1788463151.654809:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408071936:12345-0@lo:400: Request processed in 42us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463151.654816:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788463151.654902:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408071808:0@lo:400: 00000100:00100000:2.0:1788463151.654958:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463151.654991:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408072320:0@lo:400: 00000100:00100000:2.0:1788463151.655014:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463151.655046:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463151.655052:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408072192:0@lo:400: 00000100:00100000:2.0:1788463151.655075:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788463151.655108:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463151.655120:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408072320 00000100:00100000:2.0:1788463151.655123:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408072320 00000100:00100000:2.0:1788463151.655148:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408072192 00000100:00100000:2.0:1788463151.655150:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408072192 00000100:00100000:2.0:1788463151.655182:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788463151.655188:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408072320:12345-0@lo:400: 00000100:00100000:2.0:1788463151.655222:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408072320:12345-0@lo:400: Request processed in 34us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463151.655228:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788463151.655242:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788463151.655248:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408072192:12345-0@lo:400: 00000100:00100000:2.0:1788463151.655273:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408072192:12345-0@lo:400: Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463151.655279:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788463151.655292:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788463151.655313:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4bea300 x1875339408072192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463151.655323:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408072192:0@lo:400: 00010000:00080000:2.0:1788463151.655334:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5edc71180 x1875339408072320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463151.655341:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408072320:0@lo:400: 00000100:00100000:3.0:1788463151.655522:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408071808 00000100:00100000:3.0:1788463151.655527:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408071808 00000100:00100000:3.0:1788463151.655565:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788463151.655581:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408071808:12345-0@lo:400: 00000100:00100000:3.0:1788463151.655629:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408071808:12345-0@lo:400: Request processed in 49us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463151.655636:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1788463151.655869:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4be8a80 x1875339408071936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463151.655880:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408071936:0@lo:400: 00000100:00100000:2.0:1788463151.657432:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408071808:0@lo:400: 00010000:00010000:1.0:1788463151.974102:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463152.168153:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408072576:0@lo:13: 00000100:00100000:2.0:1788463152.168233:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463152.168353:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408072576 00000100:00100000:0.0:1788463152.168363:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408072576 00000100:00100000:0.0:1788463152.168419:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463152.168429:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875339408072576:12345-0@lo:13: 00002000:00000024:0.0:1788463152.168479:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463152.168529:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3279:x1875339408072576:12345-0@lo:13: Request processed in 102us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463152.168535:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788463152.169078:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5edc73b80 x1875339408072576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463152.169100:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408072576:0@lo:13: 00000001:00080000:2.0:1788463152.237552:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788463153.000643:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463154.023927:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463154.461521:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463154.461926:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395465344 00000100:00100000:3.0:1788463154.461946:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395465344 00000100:00100000:3.0:1788463154.462030:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 114 00000100:00100000:3.0:1788463154.462044:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2353:x1875339395465344:12345-192.168.204.11@tcp:250: 00010000:00080000:3.0:1788463154.462085:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae@192.168.204.11@tcp t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1788463154.462127:0:5810:0:(genops.c:1385:class_connect()) connect: client 1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae, cookie 0xc3fe72277ee35926 00000100:00080000:3.0:1788463154.462505:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec402000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463154.462613:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+5:2353:x1875339395465344:12345-192.168.204.11@tcp:250: Request processed in 569us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463154.462625:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 114 00000100:00100000:2.0:1788463154.476147:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463154.476259:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395465472 00000100:00100000:0.0:1788463154.476269:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395465472 00000100:00100000:0.0:1788463154.476335:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 115 00000100:00100000:0.0:1788463154.476346:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+5:5582:x1875339395465472:12345-192.168.204.11@tcp:101: 00010000:00010000:0.0:1788463154.476363:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463154.476381:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee3592d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dc71 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463154.476423:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee3592d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc71 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463154.476435:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee3592d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc71 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463154.476445:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0031600, rc 0) 00000100:00100000:0.0:1788463154.476513:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+6:5582:x1875339395465472:12345-192.168.204.11@tcp:101: Request processed in 168us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463154.476520:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 115 00000100:00100000:0.0:1788463154.481624:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463154.482820:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395465600 00000100:00100000:3.0:1788463154.482833:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395465600 00000100:00100000:3.0:1788463154.482894:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 116 00000100:00100000:3.0:1788463154.482903:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+6:5582:x1875339395465600:12345-192.168.204.11@tcp:501: 00000100:00100000:3.0:1788463154.483172:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+6:5582:x1875339395465600:12345-192.168.204.11@tcp:501: Request processed in 269us (1558us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463154.483181:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 116 00000100:00100000:3.0:1788463154.486903:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463154.486989:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395465728 00000100:00100000:2.0:1788463154.487000:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395465728 00000100:00100000:2.0:1788463154.487060:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 117 00000100:00100000:2.0:1788463154.487074:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+6:5582:x1875339395465728:12345-192.168.204.11@tcp:101: 00010000:00010000:2.0:1788463154.487097:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463154.487123:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8caa00/0xc3fe72277ee35934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dc78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463154.487160:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8caa00/0xc3fe72277ee35934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc78 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463154.487174:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8caa00/0xc3fe72277ee35934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc78 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463154.487185:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8caa00, rc 0) 00000100:00100000:2.0:1788463154.487252:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+7:5582:x1875339395465728:12345-192.168.204.11@tcp:101: Request processed in 183us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463154.487260:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 117 00000100:00100000:3.0:1788463154.488987:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463154.489151:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395465856 00000100:00100000:1.0:1788463154.489163:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395465856 00000100:00100000:1.0:1788463154.489216:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 118 00000100:00100000:1.0:1788463154.489232:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+7:5582:x1875339395465856:12345-192.168.204.11@tcp:501: 00000100:00100000:1.0:1788463154.489649:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:5582:x1875339395465856:12345-192.168.204.11@tcp:501: Request processed in 419us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463154.489662:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 118 00000100:00100000:1.0:1788463154.493054:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463154.493269:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395465984 00000100:00100000:2.0:1788463154.493296:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395465984 00000100:00100000:2.0:1788463154.493370:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 119 00000100:00100000:2.0:1788463154.493389:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:5582:x1875339395465984:12345-192.168.204.11@tcp:503: 00000100:00100000:2.0:1788463154.493973:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:5582:x1875339395465984:12345-192.168.204.11@tcp:503: Request processed in 588us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463154.493986:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 119 00000100:00100000:1.0:1788463154.504989:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463154.505080:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395466112 00000100:00100000:0.0:1788463154.505092:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395466112 00000100:00100000:0.0:1788463154.505153:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 120 00000100:00100000:0.0:1788463154.505164:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:5601:x1875339395466112:12345-192.168.204.11@tcp:502: 00000100:00100000:0.0:1788463154.505557:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:5601:x1875339395466112:12345-192.168.204.11@tcp:502: Request processed in 393us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463154.505566:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 120 00000100:00100000:2.0:1788463154.529302:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463154.529438:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395466240 00000100:00100000:3.0:1788463154.529463:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395466240 00000100:00100000:3.0:1788463154.529525:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 121 00000100:00100000:3.0:1788463154.529550:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:5601:x1875339395466240:12345-192.168.204.11@tcp:502: 00000100:00100000:3.0:1788463154.529869:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:5601:x1875339395466240:12345-192.168.204.11@tcp:502: Request processed in 323us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463154.529877:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 121 00000100:00100000:1.0:1788463154.540071:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463154.540132:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395466368 00000100:00100000:2.0:1788463154.540143:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395466368 00000100:00100000:2.0:1788463154.540208:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 122 00000100:00100000:2.0:1788463154.540218:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:5582:x1875339395466368:12345-192.168.204.11@tcp:101: 00010000:00010000:2.0:1788463154.540241:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463154.540264:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8ca800/0xc3fe72277ee3593b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dca2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463154.540295:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8ca800/0xc3fe72277ee3593b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca2 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463154.540306:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8ca800/0xc3fe72277ee3593b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca2 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463154.540316:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8ca800, rc 0) 00000100:00100000:2.0:1788463154.540376:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5582:x1875339395466368:12345-192.168.204.11@tcp:101: Request processed in 160us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463154.540383:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 122 00000100:00100000:3.0:1788463154.550815:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463154.551027:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395466496 00000100:00100000:2.0:1788463154.551040:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395466496 00000100:00100000:2.0:1788463154.551105:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 123 00000100:00100000:2.0:1788463154.551491:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5582:x1875339395466496:12345-192.168.204.11@tcp:256: 20000000:01000000:2.0:1788463154.551519:0:5809:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788463154.551539:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788463154.551553:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788463154.551557:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788463154.551560:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788463154.558649:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5582:x1875339395466496:12345-192.168.204.11@tcp:256: Request processed in 7513us (7830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463154.558665:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 123 00000100:00100000:3.0:1788463154.563923:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463154.563959:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395466624 00000100:00100000:3.0:1788463154.563967:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395466624 00000100:00100000:3.0:1788463154.564081:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 124 00000100:00100000:3.0:1788463154.564096:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5582:x1875339395466624:12345-192.168.204.11@tcp:101: 00010000:00010000:3.0:1788463154.564113:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463154.564138:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b1800/0xc3fe72277ee35942 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dca9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463154.564168:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b1800/0xc3fe72277ee35942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca9 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463154.564181:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b1800/0xc3fe72277ee35942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca9 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463154.564191:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1800, rc 0) 00000100:00100000:3.0:1788463154.564243:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5582:x1875339395466624:12345-192.168.204.11@tcp:101: Request processed in 153us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463154.564251:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 124 00000100:00100000:3.0:1788463154.567658:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463154.568104:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395466752 00000100:00100000:0.0:1788463154.568115:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395466752 00000100:00100000:0.0:1788463154.568205:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 125 00000100:00100000:0.0:1788463154.568216:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5582:x1875339395466752:12345-192.168.204.11@tcp:501: 00000100:00100000:0.0:1788463154.568572:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5582:x1875339395466752:12345-192.168.204.11@tcp:501: Request processed in 357us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463154.568582:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 125 00000100:00100000:3.0:1788463154.573374:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463154.573621:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395466880 00000100:00100000:0.0:1788463154.573634:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395466880 00000100:00100000:0.0:1788463154.573712:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00100000:0.0:1788463154.573724:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5582:x1875339395466880:12345-192.168.204.11@tcp:503: 00000100:00100000:0.0:1788463154.575198:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5582:x1875339395466880:12345-192.168.204.11@tcp:503: Request processed in 1077us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463154.575214:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00100000:3.0:1788463154.578227:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463154.579107:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395467008 00000100:00100000:1.0:1788463154.579120:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395467008 00000100:00100000:1.0:1788463154.579231:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 127 00000100:00100000:1.0:1788463154.579261:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5605:x1875339395467008:12345-192.168.204.11@tcp:502: 00000100:00100000:1.0:1788463154.579718:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5605:x1875339395467008:12345-192.168.204.11@tcp:502: Request processed in 459us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463154.579728:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 127 00000100:00100000:3.0:1788463154.583942:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463154.584088:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395467136 00000100:00100000:0.0:1788463154.584100:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395467136 00000100:00100000:0.0:1788463154.584156:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 128 00000100:00100000:0.0:1788463154.584166:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5605:x1875339395467136:12345-192.168.204.11@tcp:502: 00000100:00100000:0.0:1788463154.584649:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5605:x1875339395467136:12345-192.168.204.11@tcp:502: Request processed in 483us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463154.584657:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 128 00000100:00100000:1.0:1788463154.591777:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463154.592050:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395467264 00000100:00100000:2.0:1788463154.592070:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395467264 00000100:00100000:2.0:1788463154.592115:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:2.0:1788463154.592123:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1875339395467264:12345-192.168.204.11@tcp:38: 00010000:00080000:2.0:1788463154.592166:0:5816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1788463154.592228:0:5816:0:(genops.c:1385:class_connect()) connect: client c87dc105-ebf6-45f0-8943-2a25b33dd5b8, cookie 0xc3fe72277ee35949 00000004:00100000:2.0:1788463154.592260:0:5816:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788463154.592267:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788463154.621657:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9ba4c5649800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463154.621793:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2353:x1875339395467264:12345-192.168.204.11@tcp:38: Request processed in 29668us (30025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463154.621805:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00010000:00010000:1.0:1788463155.048794:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463155.629793:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463155.630363:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395467520 00000100:00100000:1.0:1788463155.630389:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395467520 00000100:00080000:2.0:1788463155.630597:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463155.630667:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:1.0:1788463155.630963:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5582:x1875339395467520:12345-192.168.204.11@tcp:41: 00000004:00000024:1.0:1788463155.631025:0:5818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788463155.631121:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5582:x1875339395467520:12345-192.168.204.11@tcp:41: Request processed in 443us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463155.631130:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:3.0:1788463155.636735:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463155.637128:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395467392 00000100:00100000:1.0:1788463155.637141:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395467392 00000100:00100000:1.0:1788463155.637999:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1788463155.638014:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:0:x1875339395467392:12345-192.168.204.11@tcp:41: 00000004:00000024:1.0:1788463155.638055:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788463155.645420:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:0:x1875339395467392:12345-192.168.204.11@tcp:41: Request processed in 7390us (8687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463155.645439:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:3.0:1788463155.649013:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463155.649145:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395467648 00000100:00100000:1.0:1788463155.649156:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395467648 00000100:00100000:1.0:1788463155.649229:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1788463155.649240:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5582:x1875339395467648:12345-192.168.204.11@tcp:40: 00000100:00100000:1.0:1788463155.649570:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5582:x1875339395467648:12345-192.168.204.11@tcp:40: Request processed in 331us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463155.649579:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:2.0:1788463155.660306:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463155.667991:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463155.668036:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463155.668097:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395468032 00000100:00100000:2.0:1788463155.668108:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395468032 00000100:00100000:2.0:1788463155.668171:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 129 00000100:00100000:2.0:1788463155.668182:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2357:x1875339395468032:12345-192.168.204.11@tcp:400: 00000100:00100000:2.0:1788463155.668259:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2357:x1875339395468032:12345-192.168.204.11@tcp:400: Request processed in 78us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463155.668267:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 129 00000100:00100000:1.0:1788463155.669579:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395467776 00000100:00100000:1.0:1788463155.669590:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395467776 00000100:00100000:1.0:1788463155.669619:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395467904 00000100:00100000:1.0:1788463155.669620:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395467904 00000100:00100000:1.0:1788463155.669673:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1788463155.669680:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875339395467776:12345-192.168.204.11@tcp:8: 00010000:00080000:1.0:1788463155.669721:0:6667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1788463155.669747:0:6667:0:(genops.c:1385:class_connect()) connect: client c87dc105-ebf6-45f0-8943-2a25b33dd5b8, cookie 0xc3fe72277ee35950 00002000:00100000:1.0:1788463155.669758:0:6667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c87dc105-ebf6-45f0-8943-2a25b33dd5b8/ffff9ba4c5649000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788463155.669778:0:6667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788463155.670265:0:6667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788463155.670301:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9ba4c564b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463155.670358:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2353:x1875339395467776:12345-192.168.204.11@tcp:8: Request processed in 677us (10065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463155.670413:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1788463155.670438:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:1.0:1788463155.670443:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1875339395467904:12345-192.168.204.11@tcp:8: 00010000:00080000:1.0:1788463155.670459:0:6667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:1.0:1788463155.670477:0:6667:0:(genops.c:1385:class_connect()) connect: client c87dc105-ebf6-45f0-8943-2a25b33dd5b8, cookie 0xc3fe72277ee35957 00002000:00100000:1.0:1788463155.670496:0:6667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c87dc105-ebf6-45f0-8943-2a25b33dd5b8/ffff9ba4c564a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788463155.670513:0:6667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788463155.670769:0:6667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788463155.670787:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9ba4c564f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463155.670817:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2353:x1875339395467904:12345-192.168.204.11@tcp:8: Request processed in 372us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463155.670824:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:1.0:1788463155.671450:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463155.671600:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395468160 00000100:00100000:3.0:1788463155.671610:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395468160 00000100:00100000:3.0:1788463155.671718:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1788463155.671728:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5582:x1875339395468160:12345-192.168.204.11@tcp:33: 00000004:00080000:3.0:1788463155.701483:0:5819:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29686us 00000004:00200000:3.0:1788463155.722278:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788463155.723104:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5582:x1875339395468160:12345-192.168.204.11@tcp:33: Request processed in 50722us (51001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463155.723121:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:0.0:1788463155.750263:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408072704:0@lo:13: 00000100:00100000:0.0:1788463155.750357:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463155.750722:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408072704 00000100:00100000:2.0:1788463155.750732:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408072704 00000100:00100000:2.0:1788463155.750797:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463155.750807:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408072704:12345-0@lo:13: 00002000:00000024:2.0:1788463155.750830:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788463155.750911:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463155.752201:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408072704:12345-0@lo:13: Request processed in 1386us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463155.752214:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788463155.753615:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f7959500 x1875339408072704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463155.753643:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408072704:0@lo:13: 00000100:00100000:0.0:1788463155.962997:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463155.963349:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395468288 00000100:00100000:1.0:1788463155.963360:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395468288 00000100:00100000:1.0:1788463155.963441:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:1.0:1788463155.963453:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5622:x1875339395468288:12345-192.168.204.11@tcp:101: 00010000:00010000:1.0:1788463155.963475:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463155.963557:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488c00/0xc3fe72277ee3595e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dcd3 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463155.963648:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35965 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463155.963673:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35965 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463155.964483:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35965 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463155.964531:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788463155.964535:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463155.964550:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35965 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463155.964596:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488c00/0xc3fe72277ee3595e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dcd3 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463155.964616:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35965 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dcd3 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463155.964625:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430a00) 00010000:00010000:1.0:1788463155.964627:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463155.964631:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489000, rc 0) 00000100:00100000:1.0:1788463155.964854:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:5622:x1875339395468288:12345-192.168.204.11@tcp:101: Request processed in 1402us (1869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463155.964863:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00010000:00010000:1.0:1788463156.069734:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463156.773118:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408073088:0@lo:400: 00000100:00100000:0.0:1788463156.773198:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463156.773266:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788463156.773273:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408072960:0@lo:400: 00000100:00100000:0.0:1788463156.773301:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463156.773333:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408073472:0@lo:400: 00000100:00100000:0.0:1788463156.773368:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463156.773558:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408072960 00000100:00100000:1.0:1788463156.773567:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408072960 00000100:00100000:1.0:1788463156.773624:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463156.773636:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408072960:12345-0@lo:400: 00000100:00100000:1.0:1788463156.773724:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408072960:12345-0@lo:400: Request processed in 91us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463156.773731:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463156.773774:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408072960:0@lo:400: 00000100:00100000:1.0:1788463156.773798:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408073088 00000100:00100000:1.0:1788463156.773801:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408073088 00000100:00100000:1.0:1788463156.773842:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408073472 00000100:00100000:1.0:1788463156.773846:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408073472 00000100:00100000:1.0:1788463156.773872:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463156.773877:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408073088:12345-0@lo:400: 00000100:00100000:1.0:1788463156.773922:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408073088:12345-0@lo:400: Request processed in 44us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463156.773928:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463156.773940:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463156.773945:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408073472:12345-0@lo:400: 00000100:00100000:1.0:1788463156.773973:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408073472:12345-0@lo:400: Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463156.773979:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788463156.773997:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788463156.774015:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5dd9880 x1875339408073472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463156.774024:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788463156.774033:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408073472:0@lo:400: 00010000:00080000:1.0:1788463156.774042:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec8f1180 x1875339408073088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463156.774049:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408073088:0@lo:400: 00000100:00100000:2.0:1788463156.774180:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408073216:0@lo:400: 00000100:00100000:2.0:1788463156.774225:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463156.774256:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788463156.774262:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408072832:0@lo:400: 00000100:00100000:2.0:1788463156.774291:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463156.774313:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408073344:0@lo:400: 00000100:00100000:2.0:1788463156.774334:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463156.774411:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408073216 00000100:00100000:1.0:1788463156.774416:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408073216 00000100:00100000:1.0:1788463156.774452:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408073344 00000100:00100000:1.0:1788463156.774455:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408073344 00000100:00100000:1.0:1788463156.774470:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463156.774476:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408073216:12345-0@lo:400: 00000100:00100000:1.0:1788463156.774516:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408073216:12345-0@lo:400: Request processed in 40us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463156.774523:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463156.774534:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463156.774547:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408073344:12345-0@lo:400: 00000100:00100000:1.0:1788463156.774578:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408073344:12345-0@lo:400: Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463156.774583:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463156.774614:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408073344:0@lo:400: 00000100:00100000:1.0:1788463156.774622:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408073216:0@lo:400: 00000100:00100000:0.0:1788463156.774983:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408072832 00000100:00100000:0.0:1788463156.774988:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408072832 00000100:00100000:0.0:1788463156.775027:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788463156.775035:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408072832:12345-0@lo:400: 00000100:00100000:0.0:1788463156.775086:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408072832:12345-0@lo:400: Request processed in 53us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463156.775092:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788463156.775168:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463156.775523:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408072832:0@lo:400: 00010000:00010000:3.0:1788463157.092997:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463157.285025:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463157.285052:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408073600:0@lo:13: 00000100:00100000:0.0:1788463157.285131:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463157.285501:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408073600 00000100:00100000:3.0:1788463157.285510:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408073600 00000100:00100000:3.0:1788463157.285567:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463157.285577:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408073600:12345-0@lo:13: 00002000:00000024:3.0:1788463157.285602:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463157.285675:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408073600:12345-0@lo:13: Request processed in 100us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463157.285718:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788463157.285952:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5edc70700 x1875339408073600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463157.285975:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408073600:0@lo:13: 00000100:00100000:2.0:1788463158.012541:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463158.013496:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395468416 00000100:00100000:1.0:1788463158.013512:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395468416 00000100:00100000:1.0:1788463158.013839:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1788463158.013852:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:5675:x1875339395468416:12345-192.168.204.11@tcp:41: 00000004:00000024:1.0:1788463158.013900:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1788463158.014088:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463158.014405:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:5675:x1875339395468416:12345-192.168.204.11@tcp:41: Request processed in 554us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463158.014415:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:0.0:1788463158.017590:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463158.017768:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395468544 00000100:00100000:3.0:1788463158.017780:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395468544 00000100:00100000:3.0:1788463158.018099:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:3.0:1788463158.018110:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5675:x1875339395468544:12345-192.168.204.11@tcp:13: 00002000:00000024:3.0:1788463158.018201:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463158.018276:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5675:x1875339395468544:12345-192.168.204.11@tcp:13: Request processed in 167us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463158.018285:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:0.0:1788463158.020429:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463158.020669:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395468672 00000100:00100000:3.0:1788463158.020679:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395468672 00000100:00100000:3.0:1788463158.021530:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:3.0:1788463158.021544:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5675:x1875339395468672:12345-192.168.204.11@tcp:13: 00002000:00000024:3.0:1788463158.021597:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463158.021708:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:5675:x1875339395468672:12345-192.168.204.11@tcp:13: Request processed in 167us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463158.021716:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00080000:2.0:1788463158.022418:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463158.022424:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463158.116916:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463159.141106:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788463159.924077:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000001:00100000:0.0:1788463159.929502:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000001:00100000:1.0:1788463159.933349:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00010000:00010000:1.0:1788463160.164842:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788463160.351096:0:8290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788463160.871494:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408073728:0@lo:13: 00000100:00100000:3.0:1788463160.871606:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463160.872151:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408073728 00000100:00100000:0.0:1788463160.872164:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408073728 00000100:00100000:0.0:1788463160.872260:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463160.872286:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408073728:12345-0@lo:13: 00002000:00000024:0.0:1788463160.872340:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463160.872421:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408073728:12345-0@lo:13: Request processed in 151us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463160.872448:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788463160.872511:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f7959500 x1875339408073728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463160.872534:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408073728:0@lo:13: 00000100:00080000:1.0:1788463160.872640:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463161.034045:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463161.034139:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463161.034177:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463161.034212:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463161.034283:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395468928 00000100:00100000:1.0:1788463161.034287:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395469056 00000100:00100000:2.0:1788463161.034299:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395468928 00000100:00100000:1.0:1788463161.034307:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395469056 00000100:00100000:1.0:1788463161.034447:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395469184 00000100:00100000:2.0:1788463161.034449:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:1.0:1788463161.034453:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395469184 00000100:00100000:2.0:1788463161.034485:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395468928:12345-192.168.204.11@tcp:400: 00000100:00100000:1.0:1788463161.034520:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1788463161.034533:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395469056:12345-192.168.204.11@tcp:400: 00000100:00100000:1.0:1788463161.034627:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395469056:12345-192.168.204.11@tcp:400: Request processed in 86us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463161.034636:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1788463161.034655:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1788463161.034663:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395469184:12345-192.168.204.11@tcp:400: 00000100:00100000:1.0:1788463161.034725:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395469184:12345-192.168.204.11@tcp:400: Request processed in 62us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463161.034733:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:2.0:1788463161.034862:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395468928:12345-192.168.204.11@tcp:400: Request processed in 123us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463161.034873:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00080000:2.0:1788463161.034912:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463161.034918:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463161.034922:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463161.038509:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395468800 00000100:00100000:0.0:1788463161.038538:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395468800 00000100:00100000:0.0:1788463161.038718:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 131 00000100:00100000:0.0:1788463161.038732:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2357:x1875339395468800:12345-192.168.204.11@tcp:400: 00000100:00100000:0.0:1788463161.039068:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2357:x1875339395468800:12345-192.168.204.11@tcp:400: Request processed in 337us (5039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463161.039077:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 131 00010000:00010000:3.0:1788463161.194349:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463161.897200:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408073856:0@lo:400: 00000100:00100000:2.0:1788463161.897321:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463161.897479:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408073856 00000100:00100000:0.0:1788463161.897490:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408073856 00000100:00100000:0.0:1788463161.897551:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788463161.897562:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408073856:12345-0@lo:400: 00000100:00100000:3.0:1788463161.897845:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408074240:0@lo:400: 00000100:00100000:3.0:1788463161.897881:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463161.897910:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463161.897915:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408074368:0@lo:400: 00000100:00100000:3.0:1788463161.897938:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463161.897967:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408073984:0@lo:400: 00000100:00100000:3.0:1788463161.897991:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463161.898009:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408074496:0@lo:400: 00000100:00100000:3.0:1788463161.898035:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463161.898056:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463161.898069:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408074112:0@lo:400: 00000100:00100000:3.0:1788463161.898094:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463161.898129:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408074240 00000100:00100000:3.0:1788463161.898134:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408074240 00000100:00100000:3.0:1788463161.898176:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408074368 00000100:00100000:3.0:1788463161.898180:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408074368 00000100:00100000:3.0:1788463161.898191:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408073984 00000100:00100000:3.0:1788463161.898193:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408073984 00000100:00100000:3.0:1788463161.898206:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463161.898212:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408074240:12345-0@lo:400: 00000100:00100000:3.0:1788463161.898268:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408074240:12345-0@lo:400: Request processed in 55us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463161.898277:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463161.898296:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463161.898302:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408074368:12345-0@lo:400: 00000100:00100000:3.0:1788463161.898330:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408074368:12345-0@lo:400: Request processed in 28us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463161.898335:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463161.898346:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788463161.898351:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408073984:12345-0@lo:400: 00000100:00100000:3.0:1788463161.898381:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408073984:12345-0@lo:400: Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463161.898386:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788463161.898414:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408074496 00000100:00100000:3.0:1788463161.898418:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408074496 00000100:00100000:3.0:1788463161.898448:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408074112 00000100:00100000:3.0:1788463161.898451:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408074112 00000100:00100000:3.0:1788463161.898465:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463161.898471:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408074496:12345-0@lo:400: 00000100:00100000:3.0:1788463161.898512:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408074496:12345-0@lo:400: Request processed in 41us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463161.898519:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788463161.898530:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463161.898535:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408074112:12345-0@lo:400: 00000100:00100000:3.0:1788463161.898561:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408074112:12345-0@lo:400: Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463161.898567:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788463161.898746:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463161.898753:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463161.898793:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408074368:0@lo:400: 00000100:00100000:3.0:1788463161.898806:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408074240:0@lo:400: 00010000:00080000:3.0:1788463161.898850:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5edc71500 x1875339408074112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463161.898861:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408074112:0@lo:400: 00000100:00100000:3.0:1788463161.898871:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408073984:0@lo:400: 00010000:00080000:3.0:1788463161.898879:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5edc70000 x1875339408074496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463161.898888:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408074496:0@lo:400: 00000100:00100000:0.0:1788463161.899030:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408073856:12345-0@lo:400: Request processed in 1467us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463161.899038:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788463161.899115:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408073856:0@lo:400: 00010000:00010000:1.0:1788463162.212839:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463162.405776:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463162.405815:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408074624:0@lo:13: 00000100:00100000:0.0:1788463162.405912:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463162.406401:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408074624 00000100:00100000:3.0:1788463162.406411:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408074624 00000100:00100000:3.0:1788463162.406522:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788463162.406535:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408074624:12345-0@lo:13: 00002000:00000024:3.0:1788463162.406596:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463162.406731:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408074624:12345-0@lo:13: Request processed in 198us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463162.406738:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788463162.408172:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5edc70000 x1875339408074624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463162.408211:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408074624:0@lo:13: 00010000:00010000:1.0:1788463163.236868:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463164.260835:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788463164.306655:0:8437:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe568aae00 20000000:00000080:0.0:1788463164.306855:0:8437:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ba5fee33000 uarg=0000000000000000 20000000:01000000:0.0:1788463164.306888:0:8437:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788463164.306891:0:8437:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788463164.306963:0:8437:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788463164.306970:0:8437:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788463164.306975:0:8437:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788463164.306989:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788463164.306992:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788463164.307379:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788463164.307383:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788463164.309384:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788463164.318443:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788463164.318975:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788463164.319032:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788463164.319059:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788463164.319062:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788463164.320622:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788463164.321175:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788463164.321240:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788463164.321274:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788463164.321291:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788463164.321294:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788463164.327444:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788463164.328658:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788463164.328989:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788463164.329049:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788463164.329069:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788463164.329072:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788463164.330638:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788463164.332437:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788463164.333361:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788463164.333414:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1788463164.333439:0:8437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788463164.333461:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.333495:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee35869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35862 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.333503:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3588c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.333510:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee358bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee358b6 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.333516:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee358cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee358c4 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.333522:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba4c56b1a00/0xc3fe72277ee358d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee358d2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.333530:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c1488a00/0xc3fe72277ee358f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee358ee expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.333536:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee3591f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35918 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.333547:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee3592d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc71 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.333622:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5ca8caa00/0xc3fe72277ee35934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc78 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.333631:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.334227:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5ca8caa00/0xc3fe72277ee35934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc78 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.334254:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba5ca8caa00/0xc3fe72277ee35934 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc78 expref: 9 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.334276:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408074752:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463164.334461:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee3592d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc71 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.334470:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee3592d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc71 expref: 9 pid: 5809 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.334480:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408074880:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463164.334514:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee3591f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35918 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.334535:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee3591f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35918 expref: 18 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.334545:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075008:0@lo:104: 00000100:00100000:2.0:1788463164.334615:0:8437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788463164.334657:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c1488a00/0xc3fe72277ee358f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee358ee expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.334677:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5c1488a00/0xc3fe72277ee358f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee358ee expref: 18 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.334718:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075136:0@lo:104: 00010000:00010000:2.0:1788463164.334751:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba4c56b1a00/0xc3fe72277ee358d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee358d2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.334759:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba4c56b1a00/0xc3fe72277ee358d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee358d2 expref: 18 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.334767:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075264:0@lo:104: 00010000:00010000:2.0:1788463164.334789:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee358cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee358c4 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.334796:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee358cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee358c4 expref: 18 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.334804:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075392:0@lo:104: 00010000:00010000:2.0:1788463164.334825:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee358bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee358b6 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.334843:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee358bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee358b6 expref: 18 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.334850:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075520:0@lo:104: 00010000:00010000:2.0:1788463164.334872:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee3588c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.334879:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee3588c expref: 18 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.334886:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075648:0@lo:104: 00010000:00010000:2.0:1788463164.335089:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee35869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35862 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.335099:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee35869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35862 expref: 18 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.335107:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075776:0@lo:104: 00000100:00100000:2.0:1788463164.335214:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463164.335464:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788463164.335490:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463164.335519:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463164.335540:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463164.335556:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463164.335564:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463164.335571:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463164.335579:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408075008 00000100:00100000:0.0:1788463164.335586:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408075008 00000100:00100000:0.0:1788463164.335630:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408075136 00000100:00100000:0.0:1788463164.335632:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408075136 00000100:00100000:0.0:1788463164.335642:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408075264 00000100:00100000:0.0:1788463164.335644:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408075264 00000100:00100000:0.0:1788463164.335652:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408075392 00000100:00100000:0.0:1788463164.335654:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408075392 00000100:00100000:0.0:1788463164.335674:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408075520 00000100:00100000:0.0:1788463164.335676:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408075520 00000100:00100000:0.0:1788463164.335713:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408075648 00000100:00100000:0.0:1788463164.335716:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408075648 00000100:00100000:0.0:1788463164.335726:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408075776 00000100:00100000:0.0:1788463164.335728:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408075776 00000100:00100000:0.0:1788463164.335740:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463164.335750:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c5148050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+9:8437:x1875339408075008:12345-0@lo:104: 00010000:00010000:0.0:1788463164.335780:0:6681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.335849:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463164.335856:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c5148050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+9:8437:x1875339408075008:12345-0@lo:104: Request processed in 107us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463164.335864:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463164.336018:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463164.336029:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+8:8437:x1875339408075136:12345-0@lo:104: 00010000:00010000:1.0:1788463164.336038:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336081:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788463164.336087:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+8:8437:x1875339408075136:12345-0@lo:104: Request processed in 62us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463164.336092:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463164.336122:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463164.336136:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+7:8437:x1875339408075264:12345-0@lo:104: 00010000:00010000:1.0:1788463164.336144:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336177:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788463164.336182:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+7:8437:x1875339408075264:12345-0@lo:104: Request processed in 47us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463164.336189:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463164.336216:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463164.336223:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+6:8437:x1875339408075392:12345-0@lo:104: 00010000:00010000:1.0:1788463164.336230:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336264:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788463164.336269:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+6:8437:x1875339408075392:12345-0@lo:104: Request processed in 47us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463164.336286:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463164.336298:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463164.336304:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+5:8437:x1875339408075520:12345-0@lo:104: 00010000:00010000:1.0:1788463164.336313:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336341:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788463164.336345:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+5:8437:x1875339408075520:12345-0@lo:104: Request processed in 42us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463164.336351:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463164.336362:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463164.336368:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+4:8437:x1875339408075648:12345-0@lo:104: 00010000:00010000:1.0:1788463164.336375:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336399:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788463164.336404:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+4:8437:x1875339408075648:12345-0@lo:104: Request processed in 37us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463164.336410:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463164.336420:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788463164.336427:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:8437:x1875339408075776:12345-0@lo:104: 00010000:00010000:1.0:1788463164.336434:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336459:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788463164.336463:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:8437:x1875339408075776:12345-0@lo:104: Request processed in 38us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463164.336474:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1788463164.336497:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788463164.336505:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336513:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463164.336520:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336530:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463164.336537:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463164.336543:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463164.336583:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336589:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463164.336611:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336618:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030800/0xc3fe72277ee35918 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee3591f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336634:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788463164.336637:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336651:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cac00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463164.336654:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336660:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463164.336666:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463164.336672:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463164.336710:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336715:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463164.336721:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336727:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cac00/0xc3fe72277ee358ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358f5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336736:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788463164.336740:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336746:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703a000 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463164.336749:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336767:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463164.336773:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463164.336778:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463164.336794:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336800:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463164.336818:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336825:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5e703a000/0xc3fe72277ee358d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358d9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336836:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788463164.336839:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336845:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703ba00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463164.336848:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336853:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463164.336860:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463164.336869:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463164.336886:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.336891:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463164.337182:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337191:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5e703ba00/0xc3fe72277ee358c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358cb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337215:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788463164.337218:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337224:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030e00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463164.337227:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337233:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463164.337239:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463164.337244:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463164.337259:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337265:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463164.337276:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337282:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030e00/0xc3fe72277ee358b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee358bd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337292:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463164.337295:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337302:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cae00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463164.337305:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337311:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463164.337317:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463164.337323:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463164.337336:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337342:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463164.337346:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337353:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cae00/0xc3fe72277ee3588c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35893 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337361:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463164.337371:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337377:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8ca400 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463164.337380:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337387:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463164.337393:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463164.337398:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463164.337414:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337419:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463164.337423:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337429:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca400/0xc3fe72277ee35862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35869 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463164.337444:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463164.337446:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463164.337449:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463164.337467:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463164.337475:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463164.337509:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408075904:0@lo:103: 00000100:00100000:1.0:1788463164.337570:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463164.337609:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408076416:0@lo:103: 00000100:00100000:1.0:1788463164.337631:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463164.337654:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788463164.337676:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408076032:0@lo:103: 00000100:00100000:1.0:1788463164.337726:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463164.337741:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408076544:0@lo:103: 00000100:00100000:1.0:1788463164.337758:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463164.337782:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408076288:0@lo:103: 00000100:00100000:1.0:1788463164.337819:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463164.337835:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788463164.337840:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408076160:0@lo:103: 00000100:00100000:1.0:1788463164.337860:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463164.337869:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408076672:0@lo:103: 00000100:00100000:1.0:1788463164.337887:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788463164.338519:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463164.338539:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408075904 00000100:00100000:0.0:1788463164.338548:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408075904 00010000:00010000:0.0:1788463164.338653:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee3591f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35918 expref: 19 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463164.338754:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408076416 00000100:00100000:0.0:1788463164.338757:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408076416 00010000:00010000:0.0:1788463164.338771:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee358bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee358b6 expref: 20 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463164.338781:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408076032 00000100:00100000:0.0:1788463164.338784:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408076032 00010000:00010000:0.0:1788463164.338793:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c1488a00/0xc3fe72277ee358f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee358ee expref: 21 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463164.338802:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408076544 00000100:00100000:0.0:1788463164.338804:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408076544 00010000:00010000:0.0:1788463164.338813:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35893 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3588c expref: 22 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463164.338821:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408076288 00000100:00100000:0.0:1788463164.338824:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408076288 00010000:00010000:0.0:1788463164.338833:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee358cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee358c4 expref: 23 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463164.338854:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408076160 00000100:00100000:0.0:1788463164.338856:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408076160 00010000:00010000:0.0:1788463164.338868:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba4c56b1a00/0xc3fe72277ee358d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee358d2 expref: 24 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463164.338877:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408076672 00000100:00100000:0.0:1788463164.338879:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408076672 00010000:00010000:0.0:1788463164.338889:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee35869 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35862 expref: 25 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463164.339277:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463164.339288:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+25:3276:x1875339408075904:12345-0@lo:103: 00010000:00010000:0.0:1788463164.339305:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463164.339311:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee3591f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35918 expref: 25 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339323:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee3591f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35918 expref: 25 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339347:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463164.339418:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+25:3276:x1875339408075904:12345-0@lo:103: Request processed in 133us (1847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463164.339426:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463164.339444:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463164.339451:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+24:3276:x1875339408076416:12345-0@lo:103: 00010000:00010000:0.0:1788463164.339460:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463164.339464:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee358bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee358b6 expref: 24 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339484:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee358bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee358b6 expref: 24 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339494:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463164.339518:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+24:3276:x1875339408076416:12345-0@lo:103: Request processed in 68us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463164.339524:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463164.339538:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788463164.339544:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4bea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+23:3276:x1875339408076032:12345-0@lo:103: 00010000:00010000:0.0:1788463164.339570:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463164.339576:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c1488a00/0xc3fe72277ee358f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee358ee expref: 23 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339585:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c1488a00/0xc3fe72277ee358f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee358ee expref: 23 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339595:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463164.339616:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4bea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+23:3276:x1875339408076032:12345-0@lo:103: Request processed in 73us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463164.339621:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788463164.339633:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788463164.339639:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4bea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+22:3276:x1875339408076544:12345-0@lo:103: 00010000:00010000:0.0:1788463164.339647:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463164.339651:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35893 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3588c expref: 22 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339659:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee3588c expref: 22 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339709:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463164.339735:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4bea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+22:3276:x1875339408076544:12345-0@lo:103: Request processed in 96us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463164.339741:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788463164.339754:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463164.339759:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+21:3279:x1875339408076288:12345-0@lo:103: 00010000:00010000:0.0:1788463164.339767:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463164.339772:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee358cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee358c4 expref: 21 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339779:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee358cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee358c4 expref: 21 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339788:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463164.339809:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+21:3279:x1875339408076288:12345-0@lo:103: Request processed in 50us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463164.339814:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463164.339825:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463164.339831:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+20:3279:x1875339408076160:12345-0@lo:103: 00010000:00010000:0.0:1788463164.339838:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463164.339845:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba4c56b1a00/0xc3fe72277ee358d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee358d2 expref: 20 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339852:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba4c56b1a00/0xc3fe72277ee358d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee358d2 expref: 20 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339860:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463164.339889:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+20:3279:x1875339408076160:12345-0@lo:103: Request processed in 58us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463164.339907:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463164.339920:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788463164.339927:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408076672:12345-0@lo:103: 00010000:00010000:0.0:1788463164.339934:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463164.339939:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee35869 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35862 expref: 19 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339946:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee35869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35862 expref: 19 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.339955:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463164.339973:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c8992c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408076672:12345-0@lo:103: Request processed in 47us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463164.339978:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788463164.340044:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408076032:0@lo:103: 00000100:00100000:0.0:1788463164.340054:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408076544:0@lo:103: 00000100:00100000:0.0:1788463164.340062:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408075904:0@lo:103: 00000100:00100000:0.0:1788463164.340069:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408076416:0@lo:103: 00000100:00100000:1.0:1788463164.340236:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408076672:0@lo:103: 00000100:00100000:1.0:1788463164.340250:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408076288:0@lo:103: 00000100:00100000:1.0:1788463164.340266:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408076160:0@lo:103: 00010000:00010000:2.0:1788463164.341598:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee3591f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35918 expref: 18 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.341620:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075008:0@lo:104: 00010000:00010000:2.0:1788463164.341635:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c1488a00/0xc3fe72277ee358f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee358ee expref: 17 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.341642:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075136:0@lo:104: 00010000:00010000:2.0:1788463164.341650:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b1a00/0xc3fe72277ee358d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee358d2 expref: 16 pid: 5810 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.341713:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075264:0@lo:104: 00010000:00010000:2.0:1788463164.341731:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cb400/0xc3fe72277ee358cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee358c4 expref: 15 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.341738:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075392:0@lo:104: 00010000:00010000:2.0:1788463164.341748:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5e703a600/0xc3fe72277ee358bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee358b6 expref: 14 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.341757:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075520:0@lo:104: 00010000:00010000:2.0:1788463164.341767:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee3588c expref: 13 pid: 5809 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.341776:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075648:0@lo:104: 00010000:00010000:2.0:1788463164.341786:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee35869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35862 expref: 12 pid: 5811 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.341796:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408075776:0@lo:104: 00000100:00100000:2.0:1788463164.347352:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408074752:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463164.347373:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875339408074880:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463164.347434:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463164.349657:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463164.349752:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463164.349846:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395469440 00000100:00100000:2.0:1788463164.349857:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395469440 00010000:00010000:2.0:1788463164.349911:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee3592d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc71 expref: 10 pid: 5809 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.349967:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395469312 00000100:00100000:2.0:1788463164.349971:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395469312 00010000:00010000:2.0:1788463164.349985:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5ca8caa00/0xc3fe72277ee35934 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc78 expref: 11 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463164.350001:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:2.0:1788463164.350010:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:2355:x1875339395469440:12345-192.168.204.11@tcp:103: 00010000:00010000:2.0:1788463164.350026:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463164.350032:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee3592d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc71 expref: 11 pid: 5809 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.350043:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee3592d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc71 expref: 11 pid: 5809 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.350063:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee3592d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc71 expref: 11 pid: 5809 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.350084:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463164.350362:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788463164.350375:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788463164.350531:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:0.0:1788463164.350541:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2354:x1875339395469312:12345-192.168.204.11@tcp:103: 00010000:00010000:0.0:1788463164.350551:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463164.350557:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5ca8caa00/0xc3fe72277ee35934 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc78 expref: 10 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350575:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5ca8caa00/0xc3fe72277ee35934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc78 expref: 10 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350586:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8caa00/0xc3fe72277ee35934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dc78 expref: 10 pid: 5811 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350598:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350606:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350620:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350627:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350634:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350641:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350647:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488600 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463164.350652:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350659:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350699:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463164.350711:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463164.350863:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:2355:x1875339395469440:12345-192.168.204.11@tcp:103: Request processed in 853us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463164.350872:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00010000:00010000:2.0:1788463164.351664:0:8437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.351676:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463164.351725:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c1488600/0xc3fe72277ee3596c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463164.352289:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:2354:x1875339395469312:12345-192.168.204.11@tcp:103: Request processed in 1743us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463164.352298:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00010000:00010000:1.0:1788463165.285238:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463165.961373:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463165.961647:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395469568 00000100:00100000:0.0:1788463165.961657:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395469568 00000100:00100000:0.0:1788463165.961747:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 133 00000100:00100000:0.0:1788463165.961758:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:5596:x1875339395469568:12345-192.168.204.11@tcp:101: 00010000:00010000:0.0:1788463165.961777:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463165.961798:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35973 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dcda expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463165.961828:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dcda expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463165.961840:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dcda expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463165.961849:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0031000, rc 0) 00000100:00100000:0.0:1788463165.961917:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5596:x1875339395469568:12345-192.168.204.11@tcp:101: Request processed in 160us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463165.961924:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 133 00000100:00100000:3.0:1788463165.964162:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463165.964665:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395469696 00000100:00100000:0.0:1788463165.964675:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395469696 00000100:00100000:0.0:1788463165.964789:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 134 00000100:00100000:0.0:1788463165.964800:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5596:x1875339395469696:12345-192.168.204.11@tcp:501: 00000100:00100000:0.0:1788463165.965115:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5596:x1875339395469696:12345-192.168.204.11@tcp:501: Request processed in 316us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463165.965124:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 134 00000100:00100000:2.0:1788463165.977252:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463165.978398:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395469824 00000100:00100000:0.0:1788463165.978412:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395469824 00000100:00100000:0.0:1788463165.978481:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 135 00000100:00100000:0.0:1788463165.978492:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5596:x1875339395469824:12345-192.168.204.11@tcp:503: 00000100:00100000:0.0:1788463165.978796:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5596:x1875339395469824:12345-192.168.204.11@tcp:503: Request processed in 304us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463165.978804:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 135 00000100:00100000:1.0:1788463165.988242:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463165.990229:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395469952 00000100:00100000:0.0:1788463165.990244:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395469952 00000100:00100000:0.0:1788463165.990340:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 136 00000100:00100000:0.0:1788463165.990353:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:6069:x1875339395469952:12345-192.168.204.11@tcp:502: 00000100:00100000:0.0:1788463165.990757:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:6069:x1875339395469952:12345-192.168.204.11@tcp:502: Request processed in 405us (2527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463165.990767:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 136 00000100:00100000:2.0:1788463165.992411:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408076800:0@lo:13: 00000100:00100000:2.0:1788463165.992495:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463165.994590:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408076800 00000100:00100000:1.0:1788463165.994605:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408076800 00000100:00100000:1.0:1788463165.994736:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463165.994769:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408076800:12345-0@lo:13: 00002000:00000024:1.0:1788463165.994828:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463165.994912:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408076800:12345-0@lo:13: Request processed in 147us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463165.994920:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788463165.995923:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463165.995977:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fea88000 x1875339408076800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463165.996017:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408076800:0@lo:13: 00000100:00100000:3.0:1788463166.012839:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463166.013049:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395470080 00000100:00100000:0.0:1788463166.013063:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395470080 00000100:00100000:0.0:1788463166.013137:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 137 00000100:00100000:0.0:1788463166.013149:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:6069:x1875339395470080:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463166.013509:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:6069:x1875339395470080:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 360us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.013540:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 137 00000100:00100000:2.0:1788463166.034159:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463166.034747:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395470208 00000100:00100000:1.0:1788463166.034759:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395470208 00000100:00100000:1.0:1788463166.034835:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 138 00000100:00100000:1.0:1788463166.034846:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5596:x1875339395470208:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463166.034865:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463166.034884:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee3597a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dce1 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.034912:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee3597a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce1 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.034922:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee3597a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce1 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.034931:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489400, rc 0) 00000100:00100000:1.0:1788463166.034999:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5596:x1875339395470208:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 155us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.035005:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 138 00000100:00100000:2.0:1788463166.048489:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463166.049453:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395470336 00000100:00100000:1.0:1788463166.049467:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395470336 00000100:00100000:1.0:1788463166.049554:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 139 00000100:00100000:1.0:1788463166.049566:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5596:x1875339395470336:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.049968:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5596:x1875339395470336:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 403us (1490us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788463166.049977:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 139 00000100:00100000:3.0:1788463166.152440:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463166.152489:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463166.152645:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463166.152854:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395470464 00000100:00100000:1.0:1788463166.152866:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395470464 00000100:00100000:1.0:1788463166.152943:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:1.0:1788463166.152956:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395470464:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463166.153052:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395470464:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 98us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.153061:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:2.0:1788463166.153643:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395470720 00000100:00100000:2.0:1788463166.153651:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395470720 00000100:00100000:2.0:1788463166.153736:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395470592 00000100:00100000:2.0:1788463166.153740:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395470592 00000100:00100000:2.0:1788463166.153765:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:2.0:1788463166.153774:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395470720:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463166.153830:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395470720:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 58us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463166.153837:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:2.0:1788463166.153850:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:2.0:1788463166.153856:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395470592:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463166.153878:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395470592:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 22us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463166.153884:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00080000:3.0:1788463166.155048:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463166.155056:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463166.155060:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463166.308900:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788463166.308995:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788463166.309016:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba4c5230000 from 39 10000000:01000000:2.0:1788463166.309022:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463166.309071:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.309084:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.309096:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463166.309123:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408076928:0@lo:101: 00000100:00100000:2.0:1788463166.310786:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463166.310882:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.310949:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408076928 00000100:00100000:0.0:1788463166.310958:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408076928 00000100:00100000:0.0:1788463166.311013:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788463166.311023:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+12:5813:x1875339408076928:12345-0@lo:101: 00010000:00010000:0.0:1788463166.311038:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463166.311056:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0031800/0xc3fe72277ee35988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35981 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.311085:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0031800/0xc3fe72277ee35988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35981 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.311097:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0031800/0xc3fe72277ee35988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35981 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.311107:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0031800, rc 0) 00000100:00100000:0.0:1788463166.311179:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408076928:12345-0@lo:101: Request processed in 158us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.311187:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788463166.311623:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408076928:0@lo:101: 00010000:00010000:2.0:1788463166.311642:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.312453:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463166.314009:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408077056:0@lo:501: 00000100:00100000:3.0:1788463166.314087:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463166.314141:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4b00300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463166.314903:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408077056 00000100:00100000:2.0:1788463166.314913:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408077056 00000100:00100000:3.0:1788463166.315093:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788463166.315104:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408077056:12345-0@lo:501: 00000100:00100000:3.0:1788463166.315488:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408077056:12345-0@lo:501: Request processed in 385us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463166.315496:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788463166.315595:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408077056:0@lo:501: 00000100:00100000:1.0:1788463166.315656:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408077184:0@lo:503: 00000100:00100000:1.0:1788463166.315722:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.320950:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.324462:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408077184 00000100:00100000:0.0:1788463166.324480:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408077184 00000100:00100000:0.0:1788463166.324814:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788463166.324825:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408077184:12345-0@lo:503: 00000100:00100000:0.0:1788463166.325113:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408077184:12345-0@lo:503: Request processed in 290us (9390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.325123:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788463166.326578:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408077184:0@lo:503: 00000100:00100000:1.0:1788463166.337915:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8457:1875339408077312:0@lo:502: 00000100:00100000:1.0:1788463166.338019:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.338083:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463166.338640:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408077312 00000100:00100000:2.0:1788463166.338854:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408077312 00000100:00100000:2.0:1788463166.338953:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788463166.338965:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:8457:x1875339408077312:12345-0@lo:502: 00000100:00100000:2.0:1788463166.339317:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+13:8457:x1875339408077312:12345-0@lo:502: Request processed in 354us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463166.339325:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788463166.339438:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8457:1875339408077312:0@lo:502: 00000100:00100000:1.0:1788463166.339498:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8457:1875339408077440:0@lo:502: 00000100:00100000:1.0:1788463166.340468:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.348100:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.348391:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408077440 00000100:00100000:0.0:1788463166.348420:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408077440 00000100:00100000:0.0:1788463166.348476:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788463166.348485:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:8457:x1875339408077440:12345-0@lo:502: 00000100:00100000:0.0:1788463166.352596:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+13:8457:x1875339408077440:12345-0@lo:502: Request processed in 3670us (11690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.352616:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788463166.353147:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8457:1875339408077440:0@lo:502: 00000040:00080000:1.0:1788463166.353473:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788463166.354349:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788463166.354375:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788463166.354387:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.354401:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463166.354412:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788463166.354416:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788463166.354418:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788463166.354458:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.354468:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.354478:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463166.354500:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408077568:0@lo:101: 00000100:00100000:0.0:1788463166.355462:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463166.355511:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42840 going to sleep for 11 seconds 00000100:00100000:3.0:1788463166.355617:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408077568 00000100:00100000:3.0:1788463166.355627:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408077568 00000100:00100000:3.0:1788463166.355890:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788463166.355915:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+13:5813:x1875339408077568:12345-0@lo:101: 00010000:00010000:3.0:1788463166.355935:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463166.355957:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b1200/0xc3fe72277ee35996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee3598f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463166.355992:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b1200/0xc3fe72277ee35996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee3598f expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463166.356007:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b1200/0xc3fe72277ee35996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3598f expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463166.356017:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1200, rc 0) 00000100:00100000:3.0:1788463166.356062:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408077568:12345-0@lo:101: Request processed in 150us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463166.356070:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788463166.356385:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408077568:0@lo:101: 00010000:00010000:0.0:1788463166.356419:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.356429:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463166.356507:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408077696:0@lo:501: 00000100:00100000:0.0:1788463166.356556:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.372440:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408077696 00000100:00100000:1.0:1788463166.372459:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408077696 00000100:00100000:0.0:1788463166.372495:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463166.372526:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788463166.372537:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408077696:12345-0@lo:501: 00000100:00100000:1.0:1788463166.374232:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408077696:12345-0@lo:501: Request processed in 1690us (17668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.374246:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788463166.374366:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408077696:0@lo:501: 00000100:00100000:0.0:1788463166.374437:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408077824:0@lo:503: 00000100:00100000:0.0:1788463166.374509:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463166.375628:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408077824 00000100:00100000:2.0:1788463166.375730:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408077824 00000100:00100000:2.0:1788463166.375794:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788463166.375804:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408077824:12345-0@lo:503: 00000100:00100000:1.0:1788463166.376502:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463166.376611:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408077824:0@lo:503: 00000100:00100000:2.0:1788463166.378402:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408077824:12345-0@lo:503: Request processed in 2590us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463166.378418:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788463166.394924:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8458:1875339408077952:0@lo:502: 00000100:00100000:0.0:1788463166.395026:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463166.395083:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463166.395314:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408077952 00000100:00100000:3.0:1788463166.395322:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408077952 00000100:00100000:3.0:1788463166.396445:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788463166.396463:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:8458:x1875339408077952:12345-0@lo:502: 00000100:00100000:3.0:1788463166.396794:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:8458:x1875339408077952:12345-0@lo:502: Request processed in 338us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463166.396802:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788463166.396892:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8458:1875339408077952:0@lo:502: 00000020:01000000:1.0:1788463166.396926:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463166.396935:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463166.396937:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788463166.396943:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788463166.396972:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8458:1875339408078080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463166.397008:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463166.405250:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408078080 00000100:00100000:0.0:1788463166.405265:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408078080 00000100:00100000:3.0:1788463166.405390:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463166.405422:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788463166.405433:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:8458:x1875339408078080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463166.407929:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:8458:x1875339408078080:12345-0@lo:502:llog_process_th.0 Request processed in 2490us (10912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463166.407945:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788463166.408096:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8458:1875339408078080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463166.408133:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463166.408142:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463166.408144:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788463166.408151:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788463166.408321:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788463166.408343:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788463166.408352:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.408374:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463166.408383:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788463166.408386:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba5c2e32800 from 39 10000000:01000000:1.0:1788463166.408389:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788463166.408422:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.408430:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.408440:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463166.408460:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408078208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.408503:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.413934:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463166.417897:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408078208 00000100:00100000:2.0:1788463166.417914:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408078208 00000100:00100000:2.0:1788463166.417983:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788463166.417994:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+14:5813:x1875339408078208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463166.418013:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463166.418034:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8cb200/0xc3fe72277ee359a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee3599d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.418067:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8cb200/0xc3fe72277ee359a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee3599d expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.418080:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8cb200/0xc3fe72277ee359a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3599d expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.418091:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cb200, rc 0) 00000100:00100000:2.0:1788463166.418301:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408078208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 309us (9797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463166.418309:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788463166.423727:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408078208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463166.423770:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.423786:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463166.424284:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408078336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463166.424364:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463166.424413:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463166.424506:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408078336 00000100:00100000:1.0:1788463166.424587:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408078336 00000100:00100000:1.0:1788463166.424744:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788463166.424772:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408078336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.425068:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408078336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.425076:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788463166.425621:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408078336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463166.425880:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408078464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463166.425942:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463166.426015:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463166.426090:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408078464 00000100:00100000:2.0:1788463166.426096:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408078464 00000100:00100000:1.0:1788463166.426386:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788463166.426397:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408078464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.426865:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408078464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 468us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.426873:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788463166.427033:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408078464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463166.427927:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8459:1875339408078592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463166.427998:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463166.428036:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ced80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463166.428095:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408078592 00000100:00100000:1.0:1788463166.428102:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408078592 00000100:00100000:1.0:1788463166.428153:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788463166.428176:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:8459:x1875339408078592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463166.428431:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:8459:x1875339408078592:12345-0@lo:502:llog_process_th.0 Request processed in 270us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.428440:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788463166.428678:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8459:1875339408078592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463166.428759:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8459:1875339408078720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463166.428799:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463166.428819:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463166.429031:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408078720 00000100:00100000:1.0:1788463166.429036:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408078720 00000100:00100000:1.0:1788463166.429074:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788463166.429083:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:8459:x1875339408078720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463166.429264:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+15:8459:x1875339408078720:12345-0@lo:502:llog_process_th.0 Request processed in 181us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.429286:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788463166.429503:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8459:1875339408078720:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788463166.429538:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788463166.429861:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788463166.429888:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788463166.429899:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.429920:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463166.429931:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788463166.429934:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788463166.429937:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788463166.429967:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.429975:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.429984:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463166.429999:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408078848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.430033:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.430056:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29eef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463166.430119:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408078848 00000100:00100000:3.0:1788463166.430124:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408078848 00000100:00100000:3.0:1788463166.430176:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788463166.430185:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+15:5813:x1875339408078848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463166.430197:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463166.430211:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b0e00/0xc3fe72277ee359b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee359ab expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463166.430234:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b0e00/0xc3fe72277ee359b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee359ab expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463166.430245:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b0e00/0xc3fe72277ee359b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee359ab expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463166.430254:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0e00, rc 0) 00000100:00100000:3.0:1788463166.430299:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408078848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463166.430306:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788463166.430482:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408078848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463166.430495:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.430504:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463166.430563:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408078976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.430589:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.430618:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463166.430787:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408078976 00000100:00100000:1.0:1788463166.430792:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408078976 00000100:00100000:1.0:1788463166.430813:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788463166.430820:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408078976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.431080:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408078976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.431087:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788463166.431111:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408078976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.431136:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408079104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.431188:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.431205:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463166.431221:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408079104 00000100:00100000:1.0:1788463166.431225:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408079104 00000100:00100000:1.0:1788463166.431241:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788463166.431247:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408079104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.431590:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408079104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 341us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.431597:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788463166.431628:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408079104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463166.432112:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8460:1875339408079232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463166.432153:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463166.432192:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92cea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463166.432804:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408079232 00000100:00100000:1.0:1788463166.432812:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408079232 00000100:00100000:1.0:1788463166.432847:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788463166.432855:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:8460:x1875339408079232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463166.433113:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:8460:x1875339408079232:12345-0@lo:502:llog_process_th.0 Request processed in 258us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.433129:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788463166.433499:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8460:1875339408079232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788463166.433596:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463166.433605:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463166.433607:0:8460:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788463166.433613:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788463166.433909:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8460:1875339408079360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463166.433960:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463166.434024:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463166.434056:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408079360 00000100:00100000:1.0:1788463166.434061:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408079360 00000100:00100000:1.0:1788463166.434130:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788463166.434138:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:8460:x1875339408079360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463166.434523:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:8460:x1875339408079360:12345-0@lo:502:llog_process_th.0 Request processed in 376us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463166.434530:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788463166.434608:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8460:1875339408079360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788463166.434855:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463166.434861:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463166.434870:0:8460:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788463166.434875:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788463166.435045:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788463166.435066:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788463166.435082:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.435093:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463166.435104:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788463166.435107:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba5c88d5800 from 39 10000000:01000000:2.0:1788463166.435110:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463166.435138:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.435146:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.435156:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463166.435188:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408079488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463166.435224:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463166.435498:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.435641:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408079488 00000100:00100000:0.0:1788463166.435647:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408079488 00000100:00100000:0.0:1788463166.435680:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788463166.435704:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408079488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463166.435716:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463166.435730:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee359c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee359b9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.435754:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee359c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee359b9 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.435764:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee359c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee359b9 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.435781:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0031600, rc 0) 00000100:00100000:0.0:1788463166.435826:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408079488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.435832:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788463166.435973:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408079488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463166.435988:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.435998:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463166.436046:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408079616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463166.436083:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463166.436110:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.436303:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408079616 00000100:00100000:0.0:1788463166.436308:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408079616 00000100:00100000:0.0:1788463166.436328:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788463166.436335:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408079616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463166.436598:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408079616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.436605:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788463166.436850:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408079616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463166.436880:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408079744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463166.436917:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463166.436939:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.437011:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408079744 00000100:00100000:0.0:1788463166.437015:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408079744 00000100:00100000:0.0:1788463166.437034:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788463166.437040:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408079744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463166.437194:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408079744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.437201:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788463166.437394:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408079744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463166.438062:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8461:1875339408079872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463166.438107:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463166.438137:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.438251:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408079872 00000100:00100000:0.0:1788463166.438257:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408079872 00000100:00100000:0.0:1788463166.438306:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788463166.438314:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:8461:x1875339408079872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463166.438527:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:8461:x1875339408079872:12345-0@lo:502:llog_process_th.0 Request processed in 200us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.438535:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788463166.438807:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8461:1875339408079872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463166.438849:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8461:1875339408080000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463166.438879:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463166.438905:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aedc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.438946:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408080000 00000100:00100000:0.0:1788463166.438951:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408080000 00000100:00100000:0.0:1788463166.438978:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788463166.438985:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:8461:x1875339408080000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463166.439118:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:8461:x1875339408080000:12345-0@lo:502:llog_process_th.0 Request processed in 133us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.439125:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788463166.439208:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8461:1875339408080000:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788463166.439227:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788463166.439520:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788463166.439544:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788463166.439556:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.439569:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463166.439580:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788463166.439583:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788463166.439586:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788463166.439615:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.439624:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.439646:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463166.439661:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408080128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788463166.439729:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463166.439753:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4a9c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463166.439919:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408080128 00000100:00100000:2.0:1788463166.439924:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408080128 00000100:00100000:2.0:1788463166.439963:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788463166.439970:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408080128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463166.439980:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463166.439993:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee359ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee359c7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.440029:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee359ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee359c7 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.440040:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee359ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee359c7 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.440051:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8ca200, rc 0) 00000100:00100000:2.0:1788463166.440083:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408080128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463166.440090:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788463166.440339:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408080128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463166.440353:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.440363:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463166.440414:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408080256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463166.440441:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463166.440465:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4a9c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.440478:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408080256 00000100:00100000:0.0:1788463166.440481:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408080256 00000100:00100000:0.0:1788463166.440502:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788463166.440607:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408080256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463166.441087:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408080256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 577us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.441096:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788463166.441437:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408080256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463166.441477:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408080384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463166.441594:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463166.441667:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463166.441715:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408080384 00000100:00100000:2.0:1788463166.441719:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408080384 00000100:00100000:0.0:1788463166.441983:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788463166.441993:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408080384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463166.442248:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408080384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 257us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.442257:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788463166.442391:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408080384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.443099:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8462:1875339408080512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463166.443149:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.443345:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.443378:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408080512 00000100:00100000:0.0:1788463166.443384:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408080512 00000100:00100000:0.0:1788463166.443459:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788463166.443468:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:8462:x1875339408080512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463166.443777:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:8462:x1875339408080512:12345-0@lo:502:llog_process_th.0 Request processed in 310us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.443786:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788463166.443881:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8462:1875339408080512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463166.443911:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463166.443921:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463166.443924:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788463166.443932:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788463166.443958:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8462:1875339408080640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463166.443994:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.445021:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee780 going to sleep for 11 seconds 00000100:00100000:2.0:1788463166.445087:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408080640 00000100:00100000:2.0:1788463166.445095:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408080640 00000100:00100000:2.0:1788463166.445138:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788463166.445148:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:8462:x1875339408080640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463166.445800:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:8462:x1875339408080640:12345-0@lo:502:llog_process_th.0 Request processed in 481us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463166.445812:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788463166.445935:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8462:1875339408080640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463166.445970:0:8462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463166.445979:0:8462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463166.445981:0:8462:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788463166.445988:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788463166.446340:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788463166.446367:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788463166.446378:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.446399:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463166.446411:0:5813:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788463166.446414:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ba5c7d7cd40 from 1 10000000:01000000:2.0:1788463166.446418:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788463166.446449:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8caa00/0xc3fe72277ee359d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.446458:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8caa00/0xc3fe72277ee359d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463166.446469:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8caa00/0xc3fe72277ee359d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463166.446491:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408080768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463166.446551:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463166.446590:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.446863:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408080768 00000100:00100000:0.0:1788463166.446870:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408080768 00000100:00100000:0.0:1788463166.446914:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788463166.446923:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408080768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463166.446935:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463166.446949:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0030200/0xc3fe72277ee359dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee359d5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.446972:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0030200/0xc3fe72277ee359dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee359d5 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.446983:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0030200/0xc3fe72277ee359dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee359d5 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463166.446992:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0030200, rc 0) 00000100:00100000:0.0:1788463166.447031:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408080768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463166.447037:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788463166.447129:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408080768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463166.447155:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8caa00/0xc3fe72277ee359d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359dc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.447182:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8caa00/0xc3fe72277ee359d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee359dc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463166.447234:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408080896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463166.447265:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463166.447431:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463166.447472:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408080896 00000100:00100000:0.0:1788463166.447477:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408080896 00000100:00100000:0.0:1788463166.447508:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788463166.447525:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408080896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463166.448074:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408080896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 548us (806us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788463166.448094:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788463166.448155:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408080896:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788463166.448263:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788463166.449403:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8caa00/0xc3fe72277ee359d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359dc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463166.449418:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8caa00/0xc3fe72277ee359d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359dc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463167.013790:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408081280:0@lo:400:kworker.0 00000100:00100000:0.0:1788463167.013866:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463167.013937:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463167.013944:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408081408:0@lo:400:kworker.0 00000100:00100000:0.0:1788463167.013973:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463167.014007:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408081280 00000100:00100000:0.0:1788463167.014014:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408081280 00000100:00100000:0.0:1788463167.014071:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408081408 00000100:00100000:0.0:1788463167.014074:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408081408 00000100:00100000:0.0:1788463167.014097:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463167.014106:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408081280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463167.014377:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408081024:0@lo:400:kworker.0 00000100:00100000:1.0:1788463167.015147:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408081152:0@lo:400:kworker.0 00000100:00100000:3.0:1788463167.020821:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463167.020871:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408081536:0@lo:400:kworker.0 00000100:00100000:3.0:1788463167.020916:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463167.020992:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408081536 00000100:00100000:3.0:1788463167.021001:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408081536 00000100:00100000:3.0:1788463167.021064:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788463167.021073:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408081536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463167.021126:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408081536:12345-0@lo:400:kworker.0 Request processed in 54us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463167.021133:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788463167.021189:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5ddb480 x1875339408081536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463167.021203:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408081536:0@lo:400:kworker.0 00000100:00100000:0.0:1788463167.022283:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408081280:12345-0@lo:400:kworker.0 Request processed in 8171us (8410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463167.022295:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463167.022320:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408081024 00000100:00100000:0.0:1788463167.022326:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408081024 00000100:00100000:0.0:1788463167.022351:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463167.022359:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408081408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463167.022408:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408081408:12345-0@lo:400:kworker.0 Request processed in 50us (8434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463167.022413:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463167.022422:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463167.022427:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408081024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463167.022462:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408081024:12345-0@lo:400:kworker.0 Request processed in 35us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463167.022484:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788463167.022515:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463167.022520:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463167.022548:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408081408:0@lo:400:kworker.0 00000100:00100000:0.0:1788463167.022559:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408081280:0@lo:400:kworker.0 00000100:00100000:3.0:1788463167.024009:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408081024:0@lo:400:kworker.0 00000100:00100000:1.0:1788463167.024414:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463167.024744:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408081152 00000100:00100000:0.0:1788463167.024751:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408081152 00000100:00100000:0.0:1788463167.024866:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463167.024876:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408081152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463167.024940:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408081152:12345-0@lo:400:kworker.0 Request processed in 66us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463167.024947:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788463167.028321:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5dd8a80 x1875339408081152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463167.028340:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408081152:0@lo:400:kworker.0 00000100:00080000:3.0:1788463167.030326:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463167.333991:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463167.526839:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408081664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463167.526930:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463167.527036:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408081664 00000100:00100000:1.0:1788463167.527056:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408081664 00000100:00100000:1.0:1788463167.527121:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463167.527132:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408081664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463167.527191:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463167.527247:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408081664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463167.527254:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788463167.527310:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fea8b100 x1875339408081664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463167.527329:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408081664:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788463167.705456:0:8499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccceb92c0 20000000:00000080:1.0:1788463167.705475:0:8499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ba5ebc86000 uarg=0000000000000000 20000000:01000000:1.0:1788463167.705659:0:8499:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788463167.705667:0:8499:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788463167.705672:0:8499:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788463167.711035:0:8500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788463167.711359:0:8499:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788463167.725428:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788463167.725501:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788463167.725558:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788463167.725577:0:8499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788463167.725789:0:8499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.725814:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee357a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3579e expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.725822:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5e703aa00/0xc3fe72277ee357f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee357f2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.725828:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c0031a00/0xc3fe72277ee35885 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3587e expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.725854:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba4c56b1800/0xc3fe72277ee35942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca9 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.725862:0:8499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.725915:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba4c56b1800/0xc3fe72277ee35942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca9 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.725937:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba4c56b1800/0xc3fe72277ee35942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca9 expref: 9 pid: 5811 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463167.725957:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875339408081792:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463167.726354:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c0031a00/0xc3fe72277ee35885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee3587e expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.726364:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5c0031a00/0xc3fe72277ee35885 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee3587e expref: 18 pid: 5811 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463167.726374:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875339408081920:0@lo:104: 00000100:00100000:0.0:1788463167.726438:0:8499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788463167.726485:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5e703aa00/0xc3fe72277ee357f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee357f2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.726494:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5e703aa00/0xc3fe72277ee357f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee357f2 expref: 18 pid: 5810 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463167.726503:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875339408082048:0@lo:104: 00010000:00010000:0.0:1788463167.726545:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee357a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee3579e expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.726553:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee357a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee3579e expref: 18 pid: 5810 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463167.726562:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875339408082176:0@lo:104: 00000100:00100000:0.0:1788463167.726580:0:8499:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8b7f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788463167.726783:0:5800:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788463167.726804:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463167.726824:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463167.726839:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408081920 00000100:00100000:1.0:1788463167.726848:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408081920 00000100:00100000:1.0:1788463167.726901:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408082048 00000100:00100000:1.0:1788463167.726904:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408082048 00000100:00100000:1.0:1788463167.726916:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408082176 00000100:00100000:1.0:1788463167.726918:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408082176 00000100:00100000:1.0:1788463167.726932:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463167.726941:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c6cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+5:8499:x1875339408081920:12345-0@lo:104: 00010000:00010000:1.0:1788463167.726957:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727030:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463167.727037:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c6cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+5:8499:x1875339408081920:12345-0@lo:104: Request processed in 97us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463167.727045:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463167.727089:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463167.727096:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+4:8499:x1875339408082048:12345-0@lo:104: 00010000:00010000:1.0:1788463167.727104:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727149:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788463167.727154:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+4:8499:x1875339408082048:12345-0@lo:104: Request processed in 60us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463167.727160:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463167.727176:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463167.727182:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:8499:x1875339408082176:12345-0@lo:104: 00010000:00010000:1.0:1788463167.727191:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee3579e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727226:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788463167.727231:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:8499:x1875339408082176:12345-0@lo:104: Request processed in 50us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463167.727237:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788463167.727271:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788463167.727278:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727286:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0031e00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463167.727300:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727310:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463167.727317:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463167.727323:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463167.727355:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727362:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463167.727388:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727394:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031e00/0xc3fe72277ee3587e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35885 expref: -99 pid: 7617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727406:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463167.727409:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727415:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703b400 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463167.727418:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727425:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463167.727442:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463167.727447:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463167.727460:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727466:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463167.727473:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727479:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5e703b400/0xc3fe72277ee357f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357f9 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727489:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463167.727492:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee3579e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727498:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cbe00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463167.727501:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee3579e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727507:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee3579e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463167.727514:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee3579e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463167.727520:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788463167.727540:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee3579e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727547:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463167.727566:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee3579e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727573:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee3579e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee357a5 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.727587:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463167.727589:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463167.727591:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463167.727597:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463167.727611:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408082432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463167.727645:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463167.727669:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463167.727674:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408082304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463167.727725:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463167.727746:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463167.727755:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408082560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463167.727780:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463167.727808:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408082432 00000100:00100000:1.0:1788463167.727813:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408082432 00010000:00010000:1.0:1788463167.727835:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5e703aa00/0xc3fe72277ee357f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee357f2 expref: 19 pid: 5810 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463167.727855:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408082304 00010000:00010000:0.0:1788463167.728651:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463167.728680:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408082560 00000100:00100000:0.0:1788463167.728705:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408082560 00010000:00010000:0.0:1788463167.728736:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee357a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3579e expref: 20 pid: 5810 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463167.728759:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463167.728768:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:777dc377-0af3-4f9e-a02c-a691119a7ded+20:3279:x1875339408082432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463167.728784:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463167.728790:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5e703aa00/0xc3fe72277ee357f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee357f2 expref: 20 pid: 5810 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.728802:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5e703aa00/0xc3fe72277ee357f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee357f2 expref: 20 pid: 5810 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.728824:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463167.728881:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:777dc377-0af3-4f9e-a02c-a691119a7ded+20:3279:x1875339408082432:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463167.728889:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463167.728907:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463167.728913:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408082560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463167.728936:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463167.728941:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee357a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3579e expref: 19 pid: 5810 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.728948:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee357a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee3579e expref: 19 pid: 5810 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463167.728958:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463167.728985:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408082560:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463167.728992:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463167.729044:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408082560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463167.729090:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408082432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463167.729128:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875339408081920:0@lo:104: 00010000:00010000:0.0:1788463167.729154:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5e703aa00/0xc3fe72277ee357f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee357f2 expref: 18 pid: 5810 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463167.729170:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875339408082048:0@lo:104: 00010000:00010000:0.0:1788463167.729179:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee357a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee3579e expref: 17 pid: 5810 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463167.729187:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875339408082176:0@lo:104: 00000100:00100000:1.0:1788463167.730938:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408082304 00010000:00010000:1.0:1788463167.731011:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c0031a00/0xc3fe72277ee35885 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3587e expref: 17 pid: 5811 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463167.731090:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463167.731100:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:3279:x1875339408082304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463167.731120:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463167.731126:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c0031a00/0xc3fe72277ee35885 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee3587e expref: 17 pid: 5811 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.731151:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c0031a00/0xc3fe72277ee35885 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee3587e expref: 17 pid: 5811 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.731175:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0031a00/0xc3fe72277ee35885 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee3587e expref: 17 pid: 5811 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.731200:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463167.731305:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3279:x1875339408082304:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (3578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463167.731312:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463167.731392:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408082304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463167.747427:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1875339408081792:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463167.747486:0:8499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463167.754096:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463167.754211:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395470848 00000100:00100000:1.0:1788463167.754227:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395470848 00010000:00010000:1.0:1788463167.754276:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba4c56b1800/0xc3fe72277ee35942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca9 expref: 10 pid: 5811 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463167.754317:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:1.0:1788463167.754327:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2355:x1875339395470848:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463167.754343:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463167.754348:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba4c56b1800/0xc3fe72277ee35942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca9 expref: 10 pid: 5811 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754379:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba4c56b1800/0xc3fe72277ee35942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca9 expref: 10 pid: 5811 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754399:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b1800/0xc3fe72277ee35942 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca9 expref: 10 pid: 5811 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754417:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754426:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754444:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754451:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754459:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754465:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754471:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030e00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463167.754476:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754485:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754536:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463167.754548:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463167.754610:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:2355:x1875339395470848:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 284us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463167.754618:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00010000:00010000:2.0:1788463167.754676:0:8499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463167.754723:0:8499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463167.754731:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee359e3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463168.356906:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463168.905790:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463168.905874:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395470976 00000100:00100000:3.0:1788463168.905888:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395470976 00000100:00100000:3.0:1788463168.905964:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 172 00000100:00100000:3.0:1788463168.905977:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+9:5596:x1875339395470976:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463168.906000:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463168.906027:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b1e00/0xc3fe72277ee359ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dce8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463168.906085:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b1e00/0xc3fe72277ee359ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce8 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463168.906099:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b1e00/0xc3fe72277ee359ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce8 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463168.906110:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1e00, rc 0) 00000100:00100000:3.0:1788463168.906931:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5596:x1875339395470976:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 953us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463168.906940:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 172 00000100:00100000:3.0:1788463168.911198:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463168.911279:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395471104 00000100:00100000:0.0:1788463168.911297:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395471104 00000100:00100000:0.0:1788463168.911357:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 173 00000100:00100000:0.0:1788463168.911367:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5596:x1875339395471104:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463168.911788:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5596:x1875339395471104:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 421us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463168.911797:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 173 00000100:00100000:0.0:1788463168.914368:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463168.914613:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395471232 00000100:00100000:3.0:1788463168.914624:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395471232 00000100:00100000:3.0:1788463168.914679:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 174 00000100:00100000:3.0:1788463168.916799:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5596:x1875339395471232:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463168.917041:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:5596:x1875339395471232:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 259us (2679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463168.917050:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 174 00000100:00100000:2.0:1788463168.923765:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463168.924627:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395471360 00000100:00100000:3.0:1788463168.924645:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395471360 00000100:00100000:3.0:1788463168.924749:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 175 00000100:00100000:3.0:1788463168.924763:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:6126:x1875339395471360:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788463168.925101:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:6126:x1875339395471360:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 341us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463168.926369:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 175 00000100:00100000:3.0:1788463168.941428:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463168.941942:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395471488 00000100:00100000:0.0:1788463168.941954:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395471488 00000100:00100000:0.0:1788463168.942016:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 176 00000100:00100000:0.0:1788463168.942027:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:6126:x1875339395471488:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463168.942381:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:6126:x1875339395471488:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 355us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463168.942392:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 176 10000000:01000000:3.0:1788463169.076855:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788463169.076864:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba4c5230000 from 4 10000000:01000000:3.0:1788463169.076870:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463169.076918:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463169.076931:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463169.076959:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463169.076986:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408082688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463169.077060:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463169.077130:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec066780 going to sleep for 11 seconds 00000100:00100000:2.0:1788463169.081312:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408082688 00000100:00100000:2.0:1788463169.081327:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408082688 00000100:00100000:2.0:1788463169.081393:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788463169.081403:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408082688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463169.081424:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463169.081447:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee359f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee359f1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.081490:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee359f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee359f1 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.081502:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee359f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee359f1 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.081511:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cb600, rc 0) 00000100:00100000:2.0:1788463169.081598:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408082688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (4538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463169.081605:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788463169.081665:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408082688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463169.081705:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.081716:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463169.081786:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408082816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.081816:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.081842:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463169.082328:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408082816 00000100:00100000:1.0:1788463169.082335:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408082816 00000100:00100000:1.0:1788463169.082372:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788463169.082378:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408082816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463169.082636:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408082816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463169.082643:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788463169.082815:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408082816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.082849:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408082944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.082885:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.082913:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463169.082953:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408082944 00000100:00100000:1.0:1788463169.082957:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408082944 00000100:00100000:1.0:1788463169.082984:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788463169.082990:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408082944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463169.083142:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408082944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463169.083148:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788463169.083389:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408082944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463169.087335:0:8552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea89180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8552:1875339408083072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463169.087435:0:8552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463169.087500:0:8552:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463169.087900:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408083072 00000100:00100000:2.0:1788463169.087909:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408083072 00000100:00100000:2.0:1788463169.087966:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788463169.087978:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:8552:x1875339408083072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463169.088247:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:8552:x1875339408083072:12345-0@lo:502:llog_process_th.0 Request processed in 271us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463169.088256:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788463169.088431:0:8552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea89180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8552:1875339408083072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463169.088478:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788463169.088489:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463169.088492:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788463169.088500:0:8552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba4c5230000 00000020:00000080:1.0:1788463169.088503:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788463169.088593:0:8552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea89180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8552:1875339408083200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463169.088633:0:8552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463169.088657:0:8552:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cc0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463169.094519:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408083200 00000100:00100000:2.0:1788463169.094539:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408083200 00000100:00100000:2.0:1788463169.094598:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788463169.094610:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:8552:x1875339408083200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463169.101661:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:8552:x1875339408083200:12345-0@lo:502:llog_process_th.0 Request processed in 7033us (13006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463169.101699:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788463169.104281:0:8552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea89180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8552:1875339408083200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463169.104343:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463169.104360:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463169.104362:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788463169.104370:0:8552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788463169.104579:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788463169.104604:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463169.104615:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.104629:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463169.104655:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463169.104659:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c2e32800 from 4 10000000:01000000:2.0:1788463169.104662:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463169.104721:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.104729:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.104737:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463169.104759:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408083328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.104828:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.104867:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463169.104886:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408083328 00000100:00100000:2.0:1788463169.104893:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408083328 00000100:00100000:2.0:1788463169.104935:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788463169.104944:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408083328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463169.104957:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463169.104972:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee359ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.105001:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee359ff expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.105011:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee359ff expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.105032:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cbe00, rc 0) 00000100:00100000:2.0:1788463169.105070:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408083328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463169.105077:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788463169.110616:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408083328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463169.110652:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.110666:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463169.110768:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408083456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.110839:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.110882:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463169.110906:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408083456 00000100:00100000:2.0:1788463169.110911:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408083456 00000100:00100000:2.0:1788463169.110954:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788463169.110964:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408083456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.111328:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408083456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 364us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463169.111337:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788463169.111383:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408083456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.111416:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408083584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.111456:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.112254:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463169.112280:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408083584 00000100:00100000:2.0:1788463169.112286:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408083584 00000100:00100000:2.0:1788463169.112321:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788463169.112329:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408083584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.112579:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408083584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463169.112587:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788463169.112636:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408083584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.123429:0:8557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8557:1875339408083712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463169.123530:0:8557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.123571:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408083712 00000100:00100000:2.0:1788463169.123578:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408083712 00000100:00100000:2.0:1788463169.123622:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788463169.123632:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+18:8557:x1875339408083712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463169.123866:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+18:8557:x1875339408083712:12345-0@lo:502:llog_process_th.0 Request processed in 235us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463169.123874:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788463169.123925:0:8557:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463169.123946:0:8557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8557:1875339408083712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463169.123975:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463169.123985:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463169.123987:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788463169.123994:0:8557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba5c2e32800 00000020:00000080:2.0:1788463169.123997:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788463169.127876:0:8557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8557:1875339408083840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463169.127975:0:8557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.128013:0:8557:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463169.129243:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408083840 00000100:00100000:0.0:1788463169.129256:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408083840 00000100:00100000:0.0:1788463169.129316:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788463169.129327:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:8557:x1875339408083840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463169.139974:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:8557:x1875339408083840:12345-0@lo:502:llog_process_th.0 Request processed in 10636us (11986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463169.139989:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788463169.143392:0:8557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8557:1875339408083840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788463169.143453:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463169.143465:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463169.143468:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788463169.143476:0:8557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788463169.143737:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788463169.143760:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463169.143775:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.143788:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463169.143800:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463169.143804:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c88d5800 from 4 10000000:01000000:2.0:1788463169.143807:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463169.143851:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.143860:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.143869:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463169.143895:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408083968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.144204:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.144250:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463169.144270:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408083968 00000100:00100000:2.0:1788463169.144277:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408083968 00000100:00100000:2.0:1788463169.144333:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788463169.144343:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408083968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463169.144358:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463169.144383:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee35a14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35a0d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.144407:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee35a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35a0d expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.144418:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee35a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35a0d expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.144427:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cac00, rc 0) 00000100:00100000:2.0:1788463169.144466:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408083968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463169.144473:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788463169.144513:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408083968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463169.144526:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463169.144536:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463169.144583:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408084096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.144608:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.144621:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463169.144748:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408084096 00000100:00100000:0.0:1788463169.144753:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408084096 00000100:00100000:0.0:1788463169.144784:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788463169.144792:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408084096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463169.145058:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408084096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463169.145066:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788463169.145097:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408084096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463169.145138:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408084224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463169.145176:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463169.145189:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ce9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463169.145201:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408084224 00000100:00100000:0.0:1788463169.145204:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408084224 00000100:00100000:0.0:1788463169.145224:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788463169.145231:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408084224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463169.145373:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408084224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463169.145380:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788463169.145420:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408084224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463169.147447:0:8560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8560:1875339408084352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463169.147524:0:8560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.147559:0:8560:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463169.147707:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408084352 00000100:00100000:0.0:1788463169.147714:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408084352 00000100:00100000:0.0:1788463169.147755:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788463169.147766:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:8560:x1875339408084352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463169.148346:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:8560:x1875339408084352:12345-0@lo:502:llog_process_th.0 Request processed in 579us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463169.148366:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788463169.149166:0:8560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8560:1875339408084352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463169.149209:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463169.149224:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463169.149226:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788463169.149236:0:8560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba5c88d5800 00000020:00000080:2.0:1788463169.149239:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788463169.149334:0:8560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8560:1875339408084480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463169.149387:0:8560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463169.149422:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408084480 00000100:00100000:2.0:1788463169.149427:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408084480 00000100:00100000:2.0:1788463169.150579:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788463169.150593:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:8560:x1875339408084480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463169.150870:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:8560:x1875339408084480:12345-0@lo:502:llog_process_th.0 Request processed in 280us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463169.150878:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788463169.153174:0:8560:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29eecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463169.153219:0:8560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:8560:1875339408084480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463169.153263:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463169.153272:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463169.153274:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788463169.153280:0:8560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788463169.158808:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788463169.158854:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788463169.158867:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463169.158880:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463169.380861:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463170.406312:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463171.109996:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463171.110029:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408084608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463171.110125:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463171.110285:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408084608 00000100:00100000:1.0:1788463171.110294:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408084608 00000100:00100000:1.0:1788463171.110365:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463171.110375:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408084608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463171.110413:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463171.110476:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408084608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463171.110483:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788463171.110528:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fea89180 x1875339408084608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463171.110548:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408084608:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463171.110726:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463171.285959:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463171.286004:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463171.286030:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463171.286032:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395471872 00000100:00100000:3.0:1788463171.286041:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395471872 00000100:00100000:2.0:1788463171.286053:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463171.286115:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395472000 00000100:00100000:3.0:1788463171.286119:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395472000 00000100:00100000:3.0:1788463171.286136:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:3.0:1788463171.286145:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395471872:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463171.286218:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395471872:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463171.286225:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:3.0:1788463171.286254:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:3.0:1788463171.286260:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395472000:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463171.286284:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395472000:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 24us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463171.286289:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00080000:3.0:1788463171.286303:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463171.286307:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463171.287931:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395471744 00000100:00100000:3.0:1788463171.287944:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395471744 00000100:00100000:3.0:1788463171.288004:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:3.0:1788463171.288014:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395471744:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463171.288101:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395471744:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 88us (2069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463171.288109:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00080000:3.0:1788463171.288218:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463171.291734:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395471616 00000100:00100000:1.0:1788463171.291755:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395471616 00000100:00100000:1.0:1788463171.291823:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 192 00000100:00100000:1.0:1788463171.291834:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2354:x1875339395471616:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463171.291928:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2354:x1875339395471616:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 96us (5993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463171.291936:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 192 00010000:00010000:2.0:1788463171.430679:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463172.132934:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408084736:0@lo:400:kworker.0 00000100:00100000:1.0:1788463172.133030:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463172.133153:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408084736 00000100:00100000:2.0:1788463172.133163:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408084736 00000100:00100000:2.0:1788463172.133229:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788463172.133238:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408084736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463172.136174:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408084736:12345-0@lo:400:kworker.0 Request processed in 2931us (3137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463172.136190:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788463172.136302:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408084864:0@lo:400:kworker.0 00000100:00100000:2.0:1788463172.136352:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463172.136405:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408084864 00000100:00100000:2.0:1788463172.136413:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408084864 00000100:00100000:2.0:1788463172.136455:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788463172.136464:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408084864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463172.136514:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408084864:12345-0@lo:400:kworker.0 Request processed in 51us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463172.136521:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788463172.136714:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408084864:0@lo:400:kworker.0 00000100:00100000:1.0:1788463172.136807:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408084736:0@lo:400:kworker.0 00000100:00100000:1.0:1788463172.137832:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408084992:0@lo:400:kworker.0 00000100:00100000:1.0:1788463172.137880:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463172.141208:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408084992 00000100:00100000:2.0:1788463172.141225:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408084992 00000100:00100000:2.0:1788463172.141301:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463172.141313:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408084992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463172.141837:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408085120:0@lo:400:kworker.0 00000100:00100000:0.0:1788463172.141884:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463172.141956:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408085120 00000100:00100000:0.0:1788463172.141962:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408085120 00000100:00100000:0.0:1788463172.142007:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463172.142016:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408085120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463172.142070:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408085120:12345-0@lo:400:kworker.0 Request processed in 55us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463172.142078:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788463172.142099:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463172.142132:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408085120:0@lo:400:kworker.0 00000100:00100000:0.0:1788463172.142175:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408085248:0@lo:400:kworker.0 00000100:00100000:0.0:1788463172.142212:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463172.142233:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463172.142239:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408085376:0@lo:400:kworker.0 00000100:00100000:0.0:1788463172.142265:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463172.142304:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463172.142314:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788463172.142428:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408085376 00000100:00100000:0.0:1788463172.142432:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408085376 00000100:00100000:0.0:1788463172.142457:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463172.142465:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788463172.142471:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408085376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463172.142507:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408085376:12345-0@lo:400:kworker.0 Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463172.142514:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788463172.142528:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788463172.142545:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4be8a80 x1875339408085376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463172.142568:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408085376:0@lo:400:kworker.0 00000100:00100000:0.0:1788463172.142664:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408085248 00000100:00100000:0.0:1788463172.142669:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408085248 00000100:00100000:0.0:1788463172.142729:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463172.142736:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408085248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463172.142773:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408085248:12345-0@lo:400:kworker.0 Request processed in 38us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463172.142780:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788463172.142796:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463172.142814:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408085248:0@lo:400:kworker.0 00000100:00100000:2.0:1788463172.147015:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408084992:12345-0@lo:400:kworker.0 Request processed in 5693us (9122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463172.147030:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788463172.147791:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4bea300 x1875339408084992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463172.147811:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408084992:0@lo:400:kworker.0 00010000:00010000:2.0:1788463172.454257:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463172.647034:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408085504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463172.647145:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463172.647376:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408085504 00000100:00100000:3.0:1788463172.647397:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408085504 00000100:00100000:3.0:1788463172.647540:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463172.647556:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408085504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463172.647608:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463172.647680:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408085504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463172.647721:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788463172.647915:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fea88700 x1875339408085504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463172.647963:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408085504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788463173.477163:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463174.502218:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463175.536463:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788463175.558127:0:8801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788463176.243237:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463176.243270:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408085632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463176.243382:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463176.243468:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408085632 00000100:00100000:3.0:1788463176.243478:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408085632 00000100:00100000:3.0:1788463176.243551:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788463176.243563:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408085632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463176.243612:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463176.243666:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408085632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463176.243674:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788463176.243725:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463176.243767:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5edc71f80 x1875339408085632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463176.243788:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408085632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463176.398198:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463176.398245:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463176.398276:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463176.401532:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463176.401618:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395472256 00000100:00100000:3.0:1788463176.401632:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395472256 00000100:00100000:3.0:1788463176.401764:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:3.0:1788463176.401778:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395472256:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463176.401901:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395472256:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 125us (3722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463176.401928:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:3.0:1788463176.401962:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395472512 00000100:00100000:3.0:1788463176.401978:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395472512 00000100:00100000:3.0:1788463176.402011:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395472384 00000100:00100000:3.0:1788463176.402015:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395472384 00000100:00100000:3.0:1788463176.402042:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:3.0:1788463176.402048:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2355:x1875339395472512:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463176.402083:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2355:x1875339395472512:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 34us (3837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463176.402091:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:3.0:1788463176.402103:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:3.0:1788463176.402109:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2355:x1875339395472384:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463176.402132:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2355:x1875339395472384:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 24us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463176.402138:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00080000:2.0:1788463176.402517:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463176.402523:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463176.402526:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463176.404537:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395472128 00000100:00100000:1.0:1788463176.404558:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395472128 00000100:00100000:1.0:1788463176.404628:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 194 00000100:00100000:1.0:1788463176.404642:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2355:x1875339395472128:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463176.404769:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2355:x1875339395472128:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 130us (6491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463176.404779:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 194 00010000:00010000:0.0:1788463176.556953:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463177.253373:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408085760:0@lo:400:kworker.0 00000100:00100000:0.0:1788463177.253527:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463177.254819:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408085888:0@lo:400:kworker.0 00000100:00100000:1.0:1788463177.254912:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463177.255027:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408085760 00000100:00100000:2.0:1788463177.255037:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408085760 00000100:00100000:2.0:1788463177.255102:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788463177.255120:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408085760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463177.255180:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408085760:12345-0@lo:400:kworker.0 Request processed in 62us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463177.255187:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788463177.255251:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408085888 00000100:00100000:2.0:1788463177.255255:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408085888 00000100:00100000:2.0:1788463177.255286:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463177.255293:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408085888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463177.257263:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408085760:0@lo:400:kworker.0 00000100:00100000:0.0:1788463177.257319:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408086272:0@lo:400:kworker.0 00000100:00100000:0.0:1788463177.257404:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463177.257485:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408086144:0@lo:400:kworker.0 00000100:00100000:0.0:1788463177.257516:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463177.257533:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463177.257540:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408086016:0@lo:400:kworker.0 00000100:00100000:0.0:1788463177.257570:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463177.257617:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463177.257638:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788463177.257827:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408085888:0@lo:400:kworker.0 00000100:00100000:1.0:1788463177.257898:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788463177.257908:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408086272 00000100:00100000:1.0:1788463177.257916:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408086272 00000100:00100000:0.0:1788463177.257931:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408086144 00000100:00100000:0.0:1788463177.257937:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408086144 00000100:00100000:0.0:1788463177.258002:0:5817:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788463177.258003:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463177.258026:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463177.258040:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408086144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463177.258500:0:8863:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788463177.258507:0:8863:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788463177.258596:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788463177.258606:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408086272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463177.261719:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408086016 00000100:00100000:3.0:1788463177.261735:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408086016 00000100:00100000:3.0:1788463177.262018:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788463177.262034:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408086016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463177.264626:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408085888:12345-0@lo:400:kworker.0 Request processed in 9301us (9681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463177.264647:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788463177.264741:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463177.264888:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408086400:0@lo:400:kworker.0 00000100:00100000:1.0:1788463177.271125:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408086272:12345-0@lo:400:kworker.0 Request processed in 12505us (13705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463177.271160:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788463177.271535:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408086272:0@lo:400:kworker.0 00000100:00100000:0.0:1788463177.271562:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408086144:12345-0@lo:400:kworker.0 Request processed in 13521us (14040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463177.271575:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463177.271618:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408086144:0@lo:400:kworker.0 00000100:00100000:3.0:1788463177.271753:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408086016:12345-0@lo:400:kworker.0 Request processed in 9721us (14179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463177.271764:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788463177.271802:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5dd8380 x1875339408086016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463177.271817:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408086016:0@lo:400:kworker.0 00000100:00100000:2.0:1788463177.273250:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463177.274300:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408086400 00000100:00100000:3.0:1788463177.274314:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408086400 00000100:00100000:3.0:1788463177.274410:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788463177.274423:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408086400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463177.274525:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408086400:12345-0@lo:400:kworker.0 Request processed in 105us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463177.274533:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788463177.275317:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788463177.276961:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5ddbb80 x1875339408086400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463177.276984:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408086400:0@lo:400:kworker.0 00010000:00010000:1.0:1788463177.572882:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463177.769185:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408086528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463177.769282:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463177.773551:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408086528 00000100:00100000:0.0:1788463177.773575:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408086528 00000100:00100000:0.0:1788463177.773748:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788463177.773762:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408086528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463177.773815:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463177.775665:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408086528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1897us (6374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463177.775703:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788463177.775878:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fea89f80 x1875339408086528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463177.775912:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408086528:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788463178.597056:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463179.620924:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463180.660081:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463181.356961:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408086656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463181.357068:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463181.357168:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408086656 00000100:00100000:2.0:1788463181.357179:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408086656 00000100:00100000:2.0:1788463181.357256:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788463181.357267:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408086656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463181.357316:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463181.357371:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408086656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463181.357403:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788463181.357431:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463181.357473:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec5f9f80 x1875339408086656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463181.357495:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408086656:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788463181.415468:0:9047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing yml_node 00000100:00100000:1.0:1788463181.531167:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463181.531218:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463181.531245:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463181.531276:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463181.531519:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395472640 00000100:00100000:2.0:1788463181.531535:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395472640 00000100:00100000:3.0:1788463181.531679:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395472768 00000100:00100000:0.0:1788463181.531681:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395472896 00000100:00100000:3.0:1788463181.531696:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395472768 00000100:00100000:0.0:1788463181.531714:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395472896 00000100:00100000:3.0:1788463181.531754:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:3.0:1788463181.531766:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395472768:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463181.531819:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395473024 00000100:00100000:0.0:1788463181.531823:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395473024 00000100:00100000:0.0:1788463181.531851:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:0.0:1788463181.531857:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2353:x1875339395472896:12345-192.168.204.11@tcp:9:kworker.0 00000100:00100000:3.0:1788463181.531865:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395472768:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 102us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463181.531885:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 39 00000020:00000080:0.0:1788463181.531903:0:6668:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35950 00000100:00100000:3.0:1788463181.531911:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00080000:0.0:1788463181.531915:0:6668:0:(import.c:65:import_set_state_nolock()) ffff9ba4c564b000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788463181.531918:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2353:x1875339395473024:12345-192.168.204.11@tcp:9:kworker.0 00000020:00000080:3.0:1788463181.531936:0:6665:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35957 00000100:00080000:3.0:1788463181.531956:0:6665:0:(import.c:65:import_set_state_nolock()) ffff9ba4c564f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788463181.531964:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:3.0:1788463181.531980:0:6665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788463181.532307:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+2:2353:x1875339395473024:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 387us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463181.532331:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:0.0:1788463181.532836:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+2:2353:x1875339395472896:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 976us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463181.532844:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00010000:00010000:0.0:1788463181.532919:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463181.536029:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 196 00000100:00100000:2.0:1788463181.536061:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2355:x1875339395472640:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463181.536199:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2355:x1875339395472640:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 152us (4978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463181.536209:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 196 00000100:00080000:2.0:1788463181.545620:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463181.545633:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463181.545637:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788463181.545657:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463181.677470:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463182.374051:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408087040:0@lo:400:kworker.0 00000100:00100000:3.0:1788463182.374165:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463182.374244:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463182.374252:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408087168:0@lo:400:kworker.0 00000100:00100000:2.0:1788463182.374273:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408086912:0@lo:400:kworker.0 00000100:00100000:3.0:1788463182.374283:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463182.374319:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463182.374326:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408087040 00000100:00100000:3.0:1788463182.374337:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408087040 00000100:00100000:2.0:1788463182.374346:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408087424:0@lo:400:kworker.0 00000100:00100000:2.0:1788463182.374376:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463182.374418:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408086784:0@lo:400:kworker.0 00000100:00100000:0.0:1788463182.374458:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463182.374640:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408087424 00000100:00100000:3.0:1788463182.374644:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408087424 00000100:00100000:0.0:1788463182.375750:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408087296:0@lo:400:kworker.0 00000100:00100000:0.0:1788463182.375807:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463182.375884:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463182.375903:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408087040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463182.375986:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408087040:12345-0@lo:400:kworker.0 Request processed in 91us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463182.375996:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463182.376035:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408086784 00000100:00100000:0.0:1788463182.376048:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408086784 00000100:00100000:0.0:1788463182.376589:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788463182.376606:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408086784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463182.376747:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408086784:12345-0@lo:400:kworker.0 Request processed in 146us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463182.376755:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788463182.376797:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408087168 00000100:00100000:0.0:1788463182.376802:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408087168 00000100:00100000:0.0:1788463182.376860:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408086912 00000100:00100000:0.0:1788463182.376864:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408086912 00000100:00100000:0.0:1788463182.376886:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408087296 00000100:00100000:0.0:1788463182.376890:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408087296 00000100:00100000:0.0:1788463182.376908:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788463182.376914:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408087168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463182.376946:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408087168:12345-0@lo:400:kworker.0 Request processed in 32us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463182.376952:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788463182.376963:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463182.376968:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408086912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463182.377001:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408086912:12345-0@lo:400:kworker.0 Request processed in 33us (2684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463182.377006:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463182.377016:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788463182.377021:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408087296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463182.377048:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408087296:12345-0@lo:400:kworker.0 Request processed in 27us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463182.377054:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788463182.377078:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463182.377169:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408086912:0@lo:400:kworker.0 00000100:00100000:0.0:1788463182.377216:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408086784:0@lo:400:kworker.0 00000100:00100000:0.0:1788463182.377367:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408087296:0@lo:400:kworker.0 00000100:00100000:0.0:1788463182.377408:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408087168:0@lo:400:kworker.0 00010000:00080000:0.0:1788463182.377427:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5ddb480 x1875339408087040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463182.377441:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408087040:0@lo:400:kworker.0 00000100:00100000:3.0:1788463182.377734:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788463182.377746:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408087424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463182.377808:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408087424:12345-0@lo:400:kworker.0 Request processed in 66us (3432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463182.377816:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788463182.378190:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788463182.378226:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5dd8a80 x1875339408087424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463182.378239:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408087424:0@lo:400:kworker.0 00010000:00010000:0.0:1788463182.693433:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463182.887722:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463182.887760:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408087552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463182.887905:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463182.888047:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408087552 00000100:00100000:1.0:1788463182.888067:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408087552 00000100:00100000:1.0:1788463182.888138:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463182.888150:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408087552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463182.888206:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463182.888275:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408087552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463182.888285:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788463182.888349:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fea8bb80 x1875339408087552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463182.888377:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408087552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788463183.717094:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463184.742555:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788463185.573951:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:0.0:1788463185.573966:0:7636:0:(genops.c:885:class_export_put()) final put ffff9ba4c564a000/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:2.0:1788463185.574676:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c564a000/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 for lustre-OST0001 00000020:00000080:2.0:1788463185.578435:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba4c564f000 for lustre-OST0001 00000001:00100000:1.0:1788463185.591189:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:1.0:1788463185.591209:0:6697:0:(genops.c:885:class_export_put()) final put ffff9ba4c5649000/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:2.0:1788463185.594185:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c5649000/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 for lustre-OST0000 00000020:00000080:2.0:1788463185.600029:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba4c564b000 for lustre-OST0000 00010000:00010000:2.0:1788463185.766877:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463186.469490:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463186.471236:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408087680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463186.471385:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463186.471744:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408087680 00000100:00100000:1.0:1788463186.471759:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408087680 00000100:00100000:1.0:1788463186.471866:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788463186.471880:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408087680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463186.472003:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463186.472138:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408087680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463186.472147:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788463186.472316:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec5fa300 x1875339408087680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463186.472344:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408087680:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788463186.472434:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463186.639484:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463186.639535:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463186.639796:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395473280 00000100:00100000:0.0:1788463186.639811:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395473280 00000100:00100000:0.0:1788463186.639909:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:0.0:1788463186.639923:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395473280:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463186.640104:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395473152 00000100:00100000:2.0:1788463186.640118:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395473152 00000100:00100000:2.0:1788463186.640187:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 198 00000100:00100000:2.0:1788463186.640198:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2356:x1875339395473152:12345-192.168.204.11@tcp:400:kworker.0 00000100:00080000:3.0:1788463186.640550:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463186.642148:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395473280:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 2195us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463186.642194:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:2.0:1788463186.642941:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2356:x1875339395473152:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 2728us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463186.642958:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 198 00010000:00010000:3.0:1788463186.789297:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463187.495143:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408088064:0@lo:400:kworker.0 00000100:00100000:1.0:1788463187.495202:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408087808:0@lo:400:kworker.0 00000100:00100000:0.0:1788463187.495256:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463187.495335:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408087936:0@lo:400:kworker.0 00000100:00100000:0.0:1788463187.495846:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463187.495857:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463187.495860:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408088192:0@lo:400:kworker.0 00000100:00100000:0.0:1788463187.495932:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463187.495978:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408088064 00000100:00100000:0.0:1788463187.495988:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408088064 00000100:00100000:1.0:1788463187.496063:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408088320:0@lo:400:kworker.0 00000100:00100000:0.0:1788463187.496082:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788463187.496096:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408088064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463187.496252:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463187.496396:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408088064:12345-0@lo:400:kworker.0 Request processed in 301us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463187.496406:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788463187.496452:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408088192 00000100:00100000:0.0:1788463187.496458:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408088192 00000100:00100000:1.0:1788463187.496491:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408087808 00000100:00100000:1.0:1788463187.496516:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408087808 00000100:00100000:0.0:1788463187.496518:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408088320 00000100:00100000:0.0:1788463187.496526:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408088320 00000100:00100000:0.0:1788463187.496555:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788463187.496561:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408088192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463187.496609:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408088192:12345-0@lo:400:kworker.0 Request processed in 45us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463187.496617:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788463187.496639:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788463187.496646:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788463187.496657:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408088320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463187.496667:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408087808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463187.500121:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408087808:12345-0@lo:400:kworker.0 Request processed in 3435us (4241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463187.500140:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788463187.500920:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408088320:12345-0@lo:400:kworker.0 Request processed in 4259us (4654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463187.500937:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788463187.501070:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408087808:0@lo:400:kworker.0 00000100:00100000:1.0:1788463187.501225:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408088320:0@lo:400:kworker.0 00000100:00100000:1.0:1788463187.501845:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408088192:0@lo:400:kworker.0 00010000:00080000:1.0:1788463187.501873:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f795aa00 x1875339408088064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463187.501887:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408088064:0@lo:400:kworker.0 00000100:00080000:0.0:1788463187.502097:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463187.502275:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463187.502445:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408088448:0@lo:400:kworker.0 00000100:00100000:2.0:1788463187.502488:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463187.503158:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408087936 00000100:00100000:0.0:1788463187.503169:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408087936 00000100:00100000:0.0:1788463187.503230:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788463187.503241:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408087936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463187.503675:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408087936:12345-0@lo:400:kworker.0 Request processed in 435us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463187.503703:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788463187.503814:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408088448 00000100:00100000:1.0:1788463187.503819:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408088448 00000100:00100000:1.0:1788463187.503861:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463187.503869:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408088448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463187.503908:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408088448:12345-0@lo:400:kworker.0 Request processed in 41us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463187.503915:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463187.504088:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408087936:0@lo:400:kworker.0 00010000:00080000:2.0:1788463187.504104:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee4d880 x1875339408088448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463187.504115:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408088448:0@lo:400:kworker.0 00000100:00080000:0.0:1788463187.504184:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1788463187.636581:0:9242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:0.0:1788463187.821218:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463188.005579:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463188.009601:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408088576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463188.009782:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463188.009991:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408088576 00000100:00100000:1.0:1788463188.010003:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408088576 00000100:00100000:1.0:1788463188.010072:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463188.010085:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408088576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463188.010146:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463188.010229:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408088576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463188.010236:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788463188.010327:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5ddbb80 x1875339408088576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463188.010359:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408088576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788463188.836925:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463189.867059:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788463190.541194:0:9339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:0.0:1788463190.895407:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463191.592571:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463191.592605:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408088704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463191.592710:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463191.592779:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408088704 00000100:00100000:2.0:1788463191.592787:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408088704 00000100:00100000:2.0:1788463191.592858:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463191.592868:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408088704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463191.592905:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463191.592949:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408088704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463191.592957:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788463191.593010:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fe9c8000 x1875339408088704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463191.593030:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408088704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788463191.602821:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463191.758344:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463191.758379:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463191.758408:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395473408 00000100:00100000:3.0:1788463191.758419:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395473408 00000100:00100000:3.0:1788463191.758482:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 200 00000100:00100000:3.0:1788463191.758492:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2356:x1875339395473408:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463191.758560:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2356:x1875339395473408:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463191.758567:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 200 00000100:00100000:3.0:1788463191.758597:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395473536 00000100:00100000:3.0:1788463191.758601:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395473536 00000100:00100000:3.0:1788463191.758638:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:3.0:1788463191.758644:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395473536:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463191.758702:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395473536:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463191.758710:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00080000:3.0:1788463191.758828:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788463191.908840:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463192.614175:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408088960:0@lo:400:kworker.0 00000100:00100000:2.0:1788463192.614266:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463192.614306:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408089088:0@lo:400:kworker.0 00000100:00100000:2.0:1788463192.614339:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408089472:0@lo:400:kworker.0 00000100:00100000:3.0:1788463192.614371:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463192.614401:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408089216:0@lo:400:kworker.0 00000100:00100000:2.0:1788463192.614434:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463192.614458:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463192.614482:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408088960 00000100:00100000:3.0:1788463192.614486:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788463192.614493:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408088960 00000100:00100000:3.0:1788463192.614495:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408088832:0@lo:400:kworker.0 00000100:00100000:2.0:1788463192.614545:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408089216 00000100:00100000:2.0:1788463192.614549:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408089216 00000100:00100000:3.0:1788463192.614555:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463192.614589:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408089344:0@lo:400:kworker.0 00000100:00100000:2.0:1788463192.614595:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788463192.614609:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408088960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463192.614620:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463192.614669:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408088832 00000100:00100000:3.0:1788463192.614674:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408088832 00000100:00100000:2.0:1788463192.614731:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408088960:12345-0@lo:400:kworker.0 Request processed in 124us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463192.614749:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788463192.614756:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788463192.614770:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408089344 00000100:00100000:2.0:1788463192.614775:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408089344 00000100:00100000:2.0:1788463192.614797:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788463192.614802:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408089216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463192.614837:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408089216:12345-0@lo:400:kworker.0 Request processed in 35us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463192.614843:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788463192.614853:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463192.614858:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408089344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463192.614884:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408089344:12345-0@lo:400:kworker.0 Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463192.614890:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788463192.614906:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463192.614944:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408089216:0@lo:400:kworker.0 00000100:00100000:2.0:1788463192.614974:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408089344:0@lo:400:kworker.0 00000100:00100000:2.0:1788463192.614985:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408088960:0@lo:400:kworker.0 00000100:00100000:3.0:1788463192.615407:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408088832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463192.615524:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408088832:12345-0@lo:400:kworker.0 Request processed in 758us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463192.615531:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788463192.615736:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408089088 00000100:00100000:0.0:1788463192.615743:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408089088 00000100:00100000:0.0:1788463192.615800:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408089472 00000100:00100000:0.0:1788463192.615804:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408089472 00000100:00100000:0.0:1788463192.615836:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463192.615844:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408089088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463192.615889:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408089088:12345-0@lo:400:kworker.0 Request processed in 46us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463192.615895:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463192.615907:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463192.615913:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408089472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463192.615940:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408089472:12345-0@lo:400:kworker.0 Request processed in 28us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463192.615947:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788463192.615969:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788463192.616356:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5ddfb80 x1875339408089088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463192.616370:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408089088:0@lo:400:kworker.0 00000100:00100000:2.0:1788463192.623640:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408088832:0@lo:400:kworker.0 00010000:00080000:2.0:1788463192.623701:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5ddd880 x1875339408089472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463192.623718:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408089472:0@lo:400:kworker.0 00010000:00010000:3.0:1788463192.932879:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463193.125354:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408089600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463193.125424:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463193.125588:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408089600 00000100:00100000:2.0:1788463193.125596:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408089600 00000100:00100000:2.0:1788463193.125670:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463193.125679:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408089600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463193.125752:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463193.135314:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408089600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9625us (9878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463193.135330:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788463193.138201:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2d180 x1875339408089600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463193.138262:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408089600:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788463193.861152:0:9436:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:0.0:1788463193.963198:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463194.981372:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788463195.756889:0:9485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 3 15:19:54 EDT 2026 00010000:00010000:0.0:1788463196.008348:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463196.719671:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463196.719727:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408089728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463196.719829:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463196.719918:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408089728 00000100:00100000:3.0:1788463196.721133:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408089728 00000100:00100000:3.0:1788463196.721234:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788463196.721244:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408089728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463196.721287:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463196.721356:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408089728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463196.721377:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788463196.721424:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2ca80 x1875339408089728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463196.721444:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408089728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788463196.722029:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463196.872345:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463196.872398:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463196.872427:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395473792 00000100:00100000:1.0:1788463196.872439:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395473792 00000100:00100000:1.0:1788463196.872520:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:1.0:1788463196.872533:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395473792:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463196.872629:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395473792:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 99us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463196.872636:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:2.0:1788463196.872905:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395473664 00000100:00100000:2.0:1788463196.872910:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395473664 00000100:00100000:2.0:1788463196.872955:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 202 00000100:00100000:2.0:1788463196.872962:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2356:x1875339395473664:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463196.872992:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2356:x1875339395473664:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 30us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463196.872999:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 202 00000100:00080000:0.0:1788463196.873149:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788463197.029110:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463197.733379:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408090240:0@lo:400:kworker.0 00000100:00100000:0.0:1788463197.733457:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463197.733518:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463197.733525:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408090112:0@lo:400:kworker.0 00000100:00100000:2.0:1788463197.733533:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408089984:0@lo:400:kworker.0 00000100:00100000:0.0:1788463197.733570:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463197.733592:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463197.733619:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408090496:0@lo:400:kworker.0 00000100:00100000:1.0:1788463197.733635:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408089856:0@lo:400:kworker.0 00000100:00100000:2.0:1788463197.733645:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463197.733713:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463197.733763:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408090368:0@lo:400:kworker.0 00000100:00100000:1.0:1788463197.733787:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463197.735336:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408090240 00000100:00100000:0.0:1788463197.735349:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408090240 00000100:00080000:1.0:1788463197.735431:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463197.735465:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408089856 00000100:00100000:3.0:1788463197.735470:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408089984 00000100:00100000:2.0:1788463197.735472:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408089856 00000100:00100000:3.0:1788463197.735478:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408089984 00000100:00100000:2.0:1788463197.735517:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788463197.735528:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408089856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463197.735549:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408090368 00000100:00100000:3.0:1788463197.735565:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408090368 00000100:00100000:3.0:1788463197.735602:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788463197.735610:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408090240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463197.735625:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408089856:12345-0@lo:400:kworker.0 Request processed in 97us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463197.735636:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788463197.735671:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408090240:12345-0@lo:400:kworker.0 Request processed in 61us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463197.735679:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788463197.735728:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788463197.735737:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408089984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463197.735868:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408089984:12345-0@lo:400:kworker.0 Request processed in 132us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463197.735885:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788463197.735902:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788463197.735909:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408090368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463197.735950:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408090368:12345-0@lo:400:kworker.0 Request processed in 42us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463197.735956:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788463197.736143:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463197.736178:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408089856:0@lo:400:kworker.0 00000100:00100000:1.0:1788463197.736196:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408090368:0@lo:400:kworker.0 00000100:00100000:2.0:1788463197.736246:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408089984:0@lo:400:kworker.0 00000100:00100000:0.0:1788463197.736659:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408090112 00000100:00100000:0.0:1788463197.736665:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408090112 00000100:00100000:0.0:1788463197.737196:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408090496 00000100:00100000:0.0:1788463197.737201:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408090496 00000100:00100000:0.0:1788463197.737235:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463197.737245:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408090112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463197.737303:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408090112:12345-0@lo:400:kworker.0 Request processed in 60us (3733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463197.737310:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463197.737323:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788463197.737330:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408090496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463197.737378:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408090496:12345-0@lo:400:kworker.0 Request processed in 49us (3732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463197.737396:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788463197.737446:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5ddc000 x1875339408090496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463197.737459:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408090496:0@lo:400:kworker.0 00010000:00080000:0.0:1788463197.737485:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5ddd500 x1875339408090112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463197.737494:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408090112:0@lo:400:kworker.0 00000100:00100000:0.0:1788463197.737506:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408090240:0@lo:400:kworker.0 00000100:00080000:2.0:1788463197.737981:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788463198.057154:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463198.245983:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463198.246014:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408090624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463198.246334:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463198.246665:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408090624 00000100:00100000:2.0:1788463198.246675:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408090624 00000100:00100000:2.0:1788463198.246758:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463198.246768:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408090624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463198.246809:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463198.246870:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408090624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (537us total) trans 0 rc 0/0 00010000:00080000:3.0:1788463198.246932:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2ca80 x1875339408090624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463198.246952:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408090624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463198.252007:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788463199.080120:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463200.106585:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463201.126059:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463201.829499:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408090752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463201.829589:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463201.829677:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408090752 00000100:00100000:3.0:1788463201.829703:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408090752 00000100:00100000:3.0:1788463201.829757:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788463201.829764:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408090752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463201.829797:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463201.829837:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408090752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463201.829844:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788463201.829863:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788463201.829892:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2ca80 x1875339408090752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463201.829911:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408090752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463202.006002:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463202.007158:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463202.007281:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395474048 00000100:00100000:1.0:1788463202.007293:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395474048 00000100:00100000:1.0:1788463202.007377:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:1.0:1788463202.007388:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395474048:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463202.007511:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395474048:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 123us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463202.007528:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395473920 00000100:00100000:0.0:1788463202.007536:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395473920 00000100:00100000:0.0:1788463202.007575:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 204 00000100:00100000:0.0:1788463202.007583:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2356:x1875339395473920:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463202.007615:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2356:x1875339395473920:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 33us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463202.007623:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 204 00000100:00080000:3.0:1788463202.007737:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463202.007793:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 55 00010000:00010000:0.0:1788463202.149856:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463202.853314:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408091136:0@lo:400:kworker.0 00000100:00100000:3.0:1788463202.853393:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463202.853472:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463202.853480:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408091264:0@lo:400:kworker.0 00000100:00100000:3.0:1788463202.853523:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463202.853565:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408091264 00000100:00100000:3.0:1788463202.853575:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408091264 00000100:00100000:3.0:1788463202.853638:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788463202.853649:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408091264:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788463202.853752:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463202.853785:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408091264:12345-0@lo:400:kworker.0 Request processed in 138us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463202.853793:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788463202.853841:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408091264:0@lo:400:kworker.0 00000100:00100000:1.0:1788463202.853969:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408090880:0@lo:400:kworker.0 00000100:00100000:1.0:1788463202.854012:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463202.854039:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408091392:0@lo:400:kworker.0 00000100:00100000:1.0:1788463202.854078:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463202.854102:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788463202.854109:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408091008:0@lo:400:kworker.0 00000100:00100000:1.0:1788463202.854135:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463202.854154:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408091520:0@lo:400:kworker.0 00000100:00100000:1.0:1788463202.854180:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463202.854206:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408091392 00000100:00100000:1.0:1788463202.854210:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408091392 00000100:00100000:1.0:1788463202.854243:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408091008 00000100:00100000:1.0:1788463202.854247:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408091008 00000100:00100000:1.0:1788463202.854267:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788463202.854274:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408091392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463202.854314:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408091392:12345-0@lo:400:kworker.0 Request processed in 41us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463202.854321:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788463202.854335:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788463202.854341:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408091008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463202.854608:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408091008:12345-0@lo:400:kworker.0 Request processed in 266us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463202.854615:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788463202.854646:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408091008:0@lo:400:kworker.0 00000100:00100000:1.0:1788463202.854668:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408091392:0@lo:400:kworker.0 00000100:00100000:0.0:1788463202.854788:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408091136 00000100:00100000:0.0:1788463202.854793:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408091136 00000100:00100000:0.0:1788463202.854829:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408091520 00000100:00100000:0.0:1788463202.854833:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408091520 00000100:00100000:0.0:1788463202.854856:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463202.854863:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408091136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463202.854911:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408091136:12345-0@lo:400:kworker.0 Request processed in 49us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463202.854924:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463202.854939:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463202.854945:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408091520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463202.854982:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408091520:12345-0@lo:400:kworker.0 Request processed in 38us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463202.854988:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788463202.855029:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2d500 x1875339408091520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463202.855041:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408091520:0@lo:400:kworker.0 00010000:00080000:0.0:1788463202.855065:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2dc00 x1875339408091136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463202.855075:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408091136:0@lo:400:kworker.0 00000100:00100000:3.0:1788463202.855520:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408090880 00000100:00100000:3.0:1788463202.855527:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408090880 00000100:00100000:3.0:1788463202.855567:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788463202.855575:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408090880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463202.855666:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408090880:12345-0@lo:400:kworker.0 Request processed in 92us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463202.855673:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:3.0:1788463202.855731:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463202.855737:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463202.856929:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408090880:0@lo:400:kworker.0 00010000:00010000:3.0:1788463203.173036:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463203.366645:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408091648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463203.366775:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463203.367054:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408091648 00000100:00100000:2.0:1788463203.367065:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408091648 00000100:00100000:2.0:1788463203.367135:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463203.367146:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408091648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463203.367190:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463203.372728:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408091648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5564us (5934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463203.372751:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788463203.381875:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2df80 x1875339408091648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463203.381916:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408091648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788463204.197074:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463205.224078:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463206.245801:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463206.948860:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408091776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463206.948960:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463206.949047:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408091776 00000100:00100000:3.0:1788463206.949056:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408091776 00000100:00100000:3.0:1788463206.949120:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788463206.949130:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408091776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463206.949168:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463206.949216:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408091776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463206.949234:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788463206.949250:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2c000 x1875339408091776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788463206.949255:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463206.949268:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408091776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463207.112600:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463207.112646:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463207.112844:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395474176 00000100:00100000:0.0:1788463207.112854:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395474176 00000100:00100000:0.0:1788463207.112924:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 206 00000100:00100000:0.0:1788463207.112935:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2356:x1875339395474176:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463207.113011:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2356:x1875339395474176:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 77us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463207.113019:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 206 00000100:00100000:3.0:1788463207.113026:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395474304 00000100:00100000:3.0:1788463207.113033:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395474304 00000100:00100000:3.0:1788463207.113094:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:3.0:1788463207.113104:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395474304:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463207.113144:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395474304:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 42us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463207.113151:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00080000:3.0:1788463207.114075:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788463207.279177:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463207.976139:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408092032:0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.976248:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463207.976331:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408092544:0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.976374:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463207.976416:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788463207.976424:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408091904:0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.976867:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463207.976899:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408092416:0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.976926:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463207.976959:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408092288:0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.976983:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463207.977004:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463207.977009:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408092160:0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.977032:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463207.977071:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408092544 00000100:00100000:0.0:1788463207.977080:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408092544 00000100:00100000:0.0:1788463207.977140:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408092160 00000100:00100000:0.0:1788463207.977143:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408092160 00000100:00100000:0.0:1788463207.977184:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463207.977194:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408092544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.977254:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408092544:12345-0@lo:400:kworker.0 Request processed in 61us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463207.977262:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463207.977280:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463207.977287:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408092160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463207.977647:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408092032 00000100:00100000:3.0:1788463207.977653:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408092032 00000100:00100000:3.0:1788463207.977697:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408092416 00000100:00100000:3.0:1788463207.977701:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408092416 00000100:00100000:3.0:1788463207.977733:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408092288 00000100:00100000:3.0:1788463207.977736:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408092288 00000100:00100000:3.0:1788463207.977752:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788463207.977759:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408092032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463207.977931:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408092032:12345-0@lo:400:kworker.0 Request processed in 171us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463207.977939:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788463207.977954:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788463207.977960:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408092416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463207.977990:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408092416:12345-0@lo:400:kworker.0 Request processed in 31us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463207.977997:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788463207.978020:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788463207.978027:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408092288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463207.978062:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408092288:12345-0@lo:400:kworker.0 Request processed in 36us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463207.978069:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788463207.978086:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463207.978091:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463207.978131:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5be8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408092288:0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.978242:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408092160:12345-0@lo:400:kworker.0 Request processed in 954us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463207.978249:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463207.978269:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408091904 00000100:00100000:0.0:1788463207.978273:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408091904 00000100:00100000:0.0:1788463207.978660:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788463207.978671:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408091904:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788463207.978885:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5beaa00 x1875339408092160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463207.978900:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408092160:0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.978976:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408091904:12345-0@lo:400:kworker.0 Request processed in 307us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463207.978984:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788463207.979061:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408091904:0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.979076:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5be9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408092416:0@lo:400:kworker.0 00000100:00100000:0.0:1788463207.979086:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408092032:0@lo:400:kworker.0 00010000:00080000:0.0:1788463207.979098:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5be8a80 x1875339408092544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463207.979109:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5be8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408092544:0@lo:400:kworker.0 00010000:00010000:3.0:1788463208.293212:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463208.485358:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463208.485412:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408092672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463208.485507:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463208.485727:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408092672 00000100:00100000:3.0:1788463208.485741:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408092672 00000100:00100000:3.0:1788463208.485809:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788463208.485830:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408092672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463208.485887:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463208.485943:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408092672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463208.485951:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788463208.485995:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2e680 x1875339408092672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463208.486015:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408092672:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788463209.316937:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463210.345611:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463211.364998:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463212.069001:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463212.069030:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408092800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463212.069110:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463212.069472:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408092800 00000100:00100000:3.0:1788463212.069501:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408092800 00000100:00100000:3.0:1788463212.069602:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788463212.069613:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408092800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463212.069670:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463212.069766:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408092800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463212.069773:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788463212.069916:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2e680 x1875339408092800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463212.069947:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408092800:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788463212.070060:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463212.236873:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463212.236950:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463212.237075:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395474432 00000100:00100000:1.0:1788463212.237090:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395474432 00000100:00100000:1.0:1788463212.237185:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 208 00000100:00100000:1.0:1788463212.237203:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2354:x1875339395474432:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463212.237332:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2354:x1875339395474432:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 135us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463212.237342:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 208 00000100:00100000:3.0:1788463212.239285:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395474560 00000100:00100000:3.0:1788463212.239308:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395474560 00000100:00100000:3.0:1788463212.239522:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:3.0:1788463212.239537:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395474560:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463212.239761:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395474560:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 227us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463212.239769:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00080000:0.0:1788463212.240133:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788463212.388967:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463213.093030:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408093056:0@lo:400:kworker.0 00000100:00100000:2.0:1788463213.093125:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408092928:0@lo:400:kworker.0 00000100:00100000:0.0:1788463213.093227:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463213.093318:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463213.093393:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463213.093417:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408093312:0@lo:400:kworker.0 00000100:00100000:2.0:1788463213.093450:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408092928 00000100:00100000:0.0:1788463213.093452:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463213.093461:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408092928 00000100:00100000:0.0:1788463213.093479:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408093184:0@lo:400:kworker.0 00000100:00100000:0.0:1788463213.093509:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463213.093545:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408093056 00000100:00100000:2.0:1788463213.093547:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788463213.093551:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408093056 00000100:00100000:2.0:1788463213.093571:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408092928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463213.093585:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408093312 00000100:00100000:0.0:1788463213.093589:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408093312 00000100:00100000:0.0:1788463213.093624:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788463213.093633:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408093056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463213.093650:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408092928:12345-0@lo:400:kworker.0 Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463213.093659:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788463213.093782:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408093056:12345-0@lo:400:kworker.0 Request processed in 150us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463213.093799:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788463213.093816:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788463213.093818:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408092928:0@lo:400:kworker.0 00000100:00100000:0.0:1788463213.093827:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408093312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463213.094315:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408093312:12345-0@lo:400:kworker.0 Request processed in 221us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463213.094347:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788463213.094381:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408093184 00000100:00100000:0.0:1788463213.094386:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408093184 00000100:00100000:0.0:1788463213.094426:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788463213.094433:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408093184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463213.094469:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408093184:12345-0@lo:400:kworker.0 Request processed in 37us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463213.094476:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788463213.094499:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463213.094550:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408093056:0@lo:400:kworker.0 00000100:00100000:0.0:1788463213.095178:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408093312:0@lo:400:kworker.0 00010000:00080000:0.0:1788463213.095197:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2c380 x1875339408093184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463213.095210:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408093184:0@lo:400:kworker.0 00000100:00100000:3.0:1788463213.110588:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408093440:0@lo:400:kworker.0 00000100:00100000:3.0:1788463213.110716:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463213.111033:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463213.111046:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408093568:0@lo:400:kworker.0 00000100:00100000:3.0:1788463213.111082:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463213.113122:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408093568 00000100:00100000:0.0:1788463213.113140:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408093568 00000100:00100000:0.0:1788463213.113247:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463213.113270:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408093568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463213.113376:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408093568:12345-0@lo:400:kworker.0 Request processed in 118us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463213.113384:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788463213.114181:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463213.114281:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408093440 00000100:00100000:2.0:1788463213.114291:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408093440 00000100:00100000:2.0:1788463213.114361:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788463213.114370:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408093440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463213.114445:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408093440:12345-0@lo:400:kworker.0 Request processed in 76us (3729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463213.114454:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1788463213.114924:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fe9cbb80 x1875339408093568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463213.114942:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408093568:0@lo:400:kworker.0 00000100:00100000:3.0:1788463213.114957:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408093440:0@lo:400:kworker.0 00000100:00080000:1.0:1788463213.115195:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788463213.412970:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463213.606376:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408093696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463213.606462:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463213.606720:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408093696 00000100:00100000:3.0:1788463213.606738:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408093696 00000100:00100000:3.0:1788463213.606785:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788463213.606794:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408093696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463213.606829:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463213.606878:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408093696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463213.606884:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788463213.607058:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2d880 x1875339408093696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463213.607086:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408093696:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788463213.702142:0:10114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:20:12 (1788463212) === 00000100:00100000:2.0:1788463214.117253:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463214.117410:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395474688 00000100:00100000:0.0:1788463214.117422:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395474688 00000100:00100000:0.0:1788463214.117496:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 210 00000100:00100000:0.0:1788463214.117508:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:8127:x1875339395474688:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788463214.117525:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463214.117546:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35a1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dcef expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463214.117577:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dcef expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463214.117588:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dcef expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463214.117598:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0031e00, rc 0) 00000100:00100000:0.0:1788463214.117666:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:8127:x1875339395474688:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 161us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463214.117674:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 210 00000100:00100000:0.0:1788463214.121967:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463214.122259:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395474816 00000100:00100000:2.0:1788463214.122273:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395474816 00000100:00100000:2.0:1788463214.122338:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 211 00000100:00100000:2.0:1788463214.122348:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:8127:x1875339395474816:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788463214.122745:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:8127:x1875339395474816:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 397us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463214.122753:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 211 00000100:00100000:1.0:1788463214.134846:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463214.135269:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395474944 00000100:00100000:2.0:1788463214.135286:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395474944 00000100:00100000:2.0:1788463214.135358:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 212 00000100:00100000:2.0:1788463214.135373:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:8127:x1875339395474944:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788463214.135849:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:8127:x1875339395474944:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 478us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463214.135857:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 212 00000100:00100000:3.0:1788463214.152652:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463214.152892:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395475072 00000100:00100000:0.0:1788463214.152905:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395475072 00000100:00100000:0.0:1788463214.152973:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 213 00000100:00100000:0.0:1788463214.152985:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:8131:x1875339395475072:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463214.153360:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:8131:x1875339395475072:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 375us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463214.153378:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 213 00000100:00100000:0.0:1788463214.177931:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463214.178561:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395475200 00000100:00100000:1.0:1788463214.178573:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395475200 00000100:00100000:1.0:1788463214.178785:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 214 00000100:00100000:1.0:1788463214.178796:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:8131:x1875339395475200:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463214.179120:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:8131:x1875339395475200:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 324us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463214.179129:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 214 00000100:00100000:2.0:1788463214.187578:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463214.193699:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395475328 00000100:00100000:0.0:1788463214.193718:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395475328 00000100:00100000:0.0:1788463214.193800:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 215 00000100:00100000:0.0:1788463214.193811:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:8127:x1875339395475328:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788463214.193830:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463214.193851:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee35a22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd19 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463214.193882:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee35a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd19 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463214.193896:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee35a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd19 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463214.193906:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0030e00, rc 0) 00000100:00100000:0.0:1788463214.194012:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:8127:x1875339395475328:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 202us (6445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463214.194020:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 215 00000100:00100000:3.0:1788463214.202888:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463214.202990:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395475456 00000100:00100000:0.0:1788463214.203002:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395475456 00000100:00100000:0.0:1788463214.203062:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 216 00000100:00100000:0.0:1788463214.203073:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:8127:x1875339395475456:12345-192.168.204.11@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788463214.203101:0:5809:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788463214.203130:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788463214.203139:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788463214.203143:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788463214.203146:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788463214.212401:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:8127:x1875339395475456:12345-192.168.204.11@tcp:256:mount.lustre.0 Request processed in 9318us (9513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463214.212418:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 216 00000100:00100000:2.0:1788463214.217953:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463214.218104:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395475584 00000100:00100000:3.0:1788463214.218117:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395475584 00000100:00100000:3.0:1788463214.218181:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 217 00000100:00100000:3.0:1788463214.218192:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:8127:x1875339395475584:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788463214.218217:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463214.218378:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b1600/0xc3fe72277ee35a29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd20 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463214.218417:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b1600/0xc3fe72277ee35a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd20 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463214.218430:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b1600/0xc3fe72277ee35a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd20 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463214.218442:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1600, rc 0) 00000100:00100000:3.0:1788463214.218518:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:8127:x1875339395475584:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 327us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463214.218524:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 217 00000100:00100000:3.0:1788463214.224647:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463214.224852:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395475712 00000100:00100000:0.0:1788463214.224864:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395475712 00000100:00100000:0.0:1788463214.224926:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 218 00000100:00100000:0.0:1788463214.224937:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:8127:x1875339395475712:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788463214.225303:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:8127:x1875339395475712:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 366us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463214.225313:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 218 00000100:00100000:2.0:1788463214.227556:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463214.227787:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395475840 00000100:00100000:3.0:1788463214.227799:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395475840 00000100:00100000:3.0:1788463214.227866:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 219 00000100:00100000:3.0:1788463214.227878:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:8127:x1875339395475840:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788463214.228317:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:8127:x1875339395475840:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 439us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463214.228325:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 219 00000100:00100000:2.0:1788463214.232881:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463214.232994:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395475968 00000100:00100000:1.0:1788463214.233005:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395475968 00000100:00100000:1.0:1788463214.233072:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 220 00000100:00100000:1.0:1788463214.233083:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:8134:x1875339395475968:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463214.233471:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:8134:x1875339395475968:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 388us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463214.233480:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 220 00000100:00100000:2.0:1788463214.236248:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463214.236367:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395476096 00000100:00100000:0.0:1788463214.236382:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395476096 00000100:00100000:0.0:1788463214.236457:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 221 00000100:00100000:0.0:1788463214.236471:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:8134:x1875339395476096:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463214.236835:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:8134:x1875339395476096:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 366us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463214.236843:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 221 00000100:00100000:2.0:1788463214.249517:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463214.249562:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463214.249669:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395476352 00000100:00100000:1.0:1788463214.249680:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395476352 00000100:00100000:1.0:1788463214.249783:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395476224 00000100:00100000:1.0:1788463214.249787:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395476224 00000100:00100000:1.0:1788463214.249807:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 67 00000100:00100000:1.0:1788463214.249818:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395476352:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463214.249896:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395476352:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 80us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463214.249903:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 67 00000100:00100000:1.0:1788463214.249919:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:1.0:1788463214.249924:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2353:x1875339395476224:12345-192.168.204.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788463214.249946:0:5816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0abe103f-aa34-4171-b132-f3b0f4fb1586@192.168.204.11@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1788463214.249986:0:5816:0:(genops.c:1385:class_connect()) connect: client 0abe103f-aa34-4171-b132-f3b0f4fb1586, cookie 0xc3fe72277ee35a30 00000004:00100000:1.0:1788463214.250019:0:5816:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788463214.250351:0:5816:0:(import.c:65:import_set_state_nolock()) ffff9ba5feab1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463214.250389:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2353:x1875339395476224:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 462us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463214.250397:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00080000:2.0:1788463214.250541:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463214.255765:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463214.255854:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395476608 00000100:00100000:0.0:1788463214.255866:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395476608 00000100:00100000:0.0:1788463214.255961:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:0.0:1788463214.255972:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:8127:x1875339395476608:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788463214.256023:0:8864:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788463214.256125:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:8127:x1875339395476608:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 155us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463214.256150:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00080000:2.0:1788463214.256370:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463214.258622:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463214.258766:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463214.258855:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395476736 00000100:00100000:3.0:1788463214.258866:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395476736 00000100:00100000:3.0:1788463214.258929:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395476480 00000100:00100000:3.0:1788463214.258932:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395476480 00000100:00100000:3.0:1788463214.258962:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:3.0:1788463214.258976:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+7:8127:x1875339395476736:12345-192.168.204.11@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788463214.259102:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+7:8127:x1875339395476736:12345-192.168.204.11@tcp:40:mount.lustre.0 Request processed in 129us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463214.259110:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:3.0:1788463214.259131:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:3.0:1788463214.259137:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:0:x1875339395476480:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788463214.259155:0:5817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788463214.259196:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:0:x1875339395476480:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 59us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463214.259202:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:3.0:1788463214.266920:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463214.268170:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463214.268215:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463214.268403:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395476864 00000100:00100000:3.0:1788463214.268417:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395476864 00000100:00100000:3.0:1788463214.268468:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395476992 00000100:00100000:3.0:1788463214.268490:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395476992 00000100:00100000:3.0:1788463214.268517:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:3.0:1788463214.268526:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1875339395476864:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788463214.268564:0:8660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0abe103f-aa34-4171-b132-f3b0f4fb1586@192.168.204.11@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1788463214.268614:0:8660:0:(genops.c:1385:class_connect()) connect: client 0abe103f-aa34-4171-b132-f3b0f4fb1586, cookie 0xc3fe72277ee35a37 00002000:00100000:3.0:1788463214.268629:0:8660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0abe103f-aa34-4171-b132-f3b0f4fb1586/ffff9ba5ec400000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788463214.268658:0:8660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788463214.269057:0:8660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788463214.269101:0:8660:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec404000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463214.269186:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2353:x1875339395476864:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 658us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463214.269196:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:3.0:1788463214.269217:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:3.0:1788463214.269223:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1875339395476992:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788463214.269479:0:8660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0abe103f-aa34-4171-b132-f3b0f4fb1586@192.168.204.11@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1788463214.269502:0:8660:0:(genops.c:1385:class_connect()) connect: client 0abe103f-aa34-4171-b132-f3b0f4fb1586, cookie 0xc3fe72277ee35a3e 00002000:00100000:3.0:1788463214.269510:0:8660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0abe103f-aa34-4171-b132-f3b0f4fb1586/ffff9ba5ec403800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788463214.269520:0:8660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788463214.269731:0:8660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788463214.269751:0:8660:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec406800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463214.269788:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2353:x1875339395476992:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 563us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463214.269797:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:1.0:1788463214.271757:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395477120 00000100:00100000:1.0:1788463214.271773:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395477120 00000100:00100000:1.0:1788463214.271854:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:1.0:1788463214.271866:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:8127:x1875339395477120:12345-192.168.204.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788463214.272163:0:5819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788463214.272316:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:8127:x1875339395477120:12345-192.168.204.11@tcp:33:mount.lustre.0 Request processed in 452us (5407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463214.272325:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00010000:00010000:0.0:1788463214.437299:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463215.460893:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788463216.235549:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0abe103f-aa34-4171-b132-f3b0f4fb1586 00000001:00100000:0.0:1788463216.257807:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0abe103f-aa34-4171-b132-f3b0f4fb1586 00000001:00100000:2.0:1788463216.271942:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0abe103f-aa34-4171-b132-f3b0f4fb1586 00010000:00010000:3.0:1788463216.485046:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463217.196145:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408093824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463217.196285:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463217.198781:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408093824 00000100:00100000:1.0:1788463217.198799:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408093824 00000100:00100000:1.0:1788463217.198873:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788463217.198886:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408093824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463217.198933:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788463217.199073:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463217.204670:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408093824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5775us (8376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463217.204714:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788463217.205489:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fe9c9500 x1875339408093824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463217.205518:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408093824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463217.517210:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463218.216405:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408094208:0@lo:400:kworker.0 00000100:00100000:1.0:1788463218.216474:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408094080:0@lo:400:kworker.0 00000100:00100000:0.0:1788463218.216500:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463218.216511:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463218.216561:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408094208 00000100:00100000:3.0:1788463218.216566:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408093952:0@lo:400:kworker.0 00000100:00100000:2.0:1788463218.216569:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408094208 00000100:00100000:2.0:1788463218.216633:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463218.216662:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408094208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463218.217026:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463218.217034:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408094336:0@lo:400:kworker.0 00000100:00100000:0.0:1788463218.217075:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463218.217127:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408094080 00000100:00100000:0.0:1788463218.217132:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408094080 00000100:00100000:0.0:1788463218.217178:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408094336 00000100:00100000:0.0:1788463218.217182:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408094336 00000100:00100000:0.0:1788463218.217211:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788463218.217219:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408094080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463218.217256:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408094080:12345-0@lo:400:kworker.0 Request processed in 38us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463218.217262:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788463218.217279:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788463218.217285:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408094336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463218.217328:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408094336:12345-0@lo:400:kworker.0 Request processed in 44us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463218.217340:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788463218.217360:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463218.217393:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408094336:0@lo:400:kworker.0 00000100:00100000:1.0:1788463218.224240:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408094080:0@lo:400:kworker.0 00000100:00100000:1.0:1788463218.224260:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408094592:0@lo:400:kworker.0 00000100:00100000:1.0:1788463218.224336:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463218.224632:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463218.224663:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408094464:0@lo:400:kworker.0 00000100:00100000:3.0:1788463218.224706:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463218.224742:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408094464 00000100:00100000:3.0:1788463218.224749:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408094464 00000100:00100000:3.0:1788463218.224813:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788463218.224822:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408094464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463218.225000:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408094464:12345-0@lo:400:kworker.0 Request processed in 178us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463218.225107:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788463218.225136:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463218.225174:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408094464:0@lo:400:kworker.0 00000100:00100000:1.0:1788463218.225476:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408093952 00000100:00100000:1.0:1788463218.225482:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408093952 00000100:00100000:1.0:1788463218.225524:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788463218.225531:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408093952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463218.225575:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408093952:12345-0@lo:400:kworker.0 Request processed in 45us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463218.225581:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788463218.225841:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408093952:0@lo:400:kworker.0 00000100:00100000:0.0:1788463218.227816:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408094592 00000100:00100000:0.0:1788463218.227831:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408094592 00000100:00100000:0.0:1788463218.228052:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463218.228063:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408094592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463218.228152:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408094592:12345-0@lo:400:kworker.0 Request processed in 93us (3817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463218.228172:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788463218.229401:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec4ad880 x1875339408094592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463218.229441:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408094592:0@lo:400:kworker.0 00000100:00100000:2.0:1788463218.232425:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408094208:12345-0@lo:400:kworker.0 Request processed in 15770us (15912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463218.232442:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788463218.233517:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fe9c9500 x1875339408094208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463218.233537:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408094208:0@lo:400:kworker.0 00000100:00080000:3.0:1788463218.233698:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788463218.532863:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463218.725046:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463218.725071:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408094720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463218.725160:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463218.725365:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408094720 00000100:00100000:2.0:1788463218.725375:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408094720 00000100:00100000:2.0:1788463218.725444:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788463218.725454:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408094720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463218.725496:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463218.725557:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408094720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463218.725564:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788463218.725777:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2f800 x1875339408094720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463218.725802:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408094720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463219.406102:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463219.407984:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395477248 00000100:00100000:3.0:1788463219.408001:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395477248 00000100:00100000:3.0:1788463219.408088:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 223 00000100:00100000:3.0:1788463219.408100:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395477248:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463219.408235:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395477248:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 136us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463219.408244:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 223 00000100:00100000:3.0:1788463219.419445:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463219.419568:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463219.419620:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463219.419736:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395477760 00000100:00100000:1.0:1788463219.419750:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395477760 00000100:00100000:1.0:1788463219.419864:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:1.0:1788463219.419880:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395477760:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463219.421149:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395477760:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 1254us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463219.421163:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00080000:2.0:1788463219.421976:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463219.425319:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463219.426017:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395477632 00000100:00100000:2.0:1788463219.426029:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395477632 00000100:00100000:2.0:1788463219.426096:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:2.0:1788463219.426107:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395477632:12345-192.168.204.11@tcp:400:kworker.0 00000100:00080000:3.0:1788463219.426156:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463219.426267:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395477632:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 161us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463219.426275:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:0.0:1788463219.426736:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395477504 00000100:00100000:0.0:1788463219.426747:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395477504 00000100:00100000:0.0:1788463219.426800:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395477376 00000100:00100000:0.0:1788463219.426804:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395477376 00000100:00100000:0.0:1788463219.426843:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 71 00000100:00100000:0.0:1788463219.426854:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395477504:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463219.426892:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395477504:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 41us (7462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463219.426899:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 71 00000100:00100000:0.0:1788463219.426912:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00100000:0.0:1788463219.426918:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395477376:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463219.427123:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395477376:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 203us (7500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463219.427145:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00080000:2.0:1788463219.431000:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788463219.556953:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463220.585819:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788463221.041562:0:10313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788463221.609082:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463222.311799:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463222.311833:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408094848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463222.311935:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463222.312173:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408094848 00000100:00100000:2.0:1788463222.312192:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408094848 00000100:00100000:2.0:1788463222.312271:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788463222.312282:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408094848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463222.312325:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463222.312385:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408094848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463222.312394:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788463222.312438:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec4ac700 x1875339408094848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463222.312458:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408094848:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463222.312520:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463222.636360:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463223.337921:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408094976:0@lo:400:kworker.0 00000100:00100000:0.0:1788463223.338023:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463223.338979:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408094976 00000100:00100000:1.0:1788463223.338994:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408094976 00000100:00100000:1.0:1788463223.339265:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788463223.339277:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408094976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463223.344893:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408095232:0@lo:400:kworker.0 00000100:00100000:2.0:1788463223.344989:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463223.345046:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463223.345124:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408095360:0@lo:400:kworker.0 00000100:00100000:2.0:1788463223.345157:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463223.345206:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408095232 00000100:00100000:2.0:1788463223.345217:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408095232 00000100:00100000:2.0:1788463223.345278:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788463223.345287:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c845fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408095232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463223.345361:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c845fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408095232:12345-0@lo:400:kworker.0 Request processed in 74us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463223.345370:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788463223.345662:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c2e2ea00 x1875339408095232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463223.345680:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408095232:0@lo:400:kworker.0 00000100:00100000:1.0:1788463223.345868:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408094976:12345-0@lo:400:kworker.0 Request processed in 6591us (7842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463223.345881:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788463223.345948:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408095104:0@lo:400:kworker.0 00000100:00100000:1.0:1788463223.345982:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463223.346017:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408095616:0@lo:400:kworker.0 00000100:00100000:1.0:1788463223.346053:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463223.346095:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788463223.346102:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408095488:0@lo:400:kworker.0 00000100:00100000:1.0:1788463223.346126:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463223.346155:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408095616 00000100:00100000:1.0:1788463223.346160:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408095616 00000100:00100000:1.0:1788463223.346204:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788463223.346214:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408095616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463223.346255:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408095616:12345-0@lo:400:kworker.0 Request processed in 43us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463223.346262:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788463223.346281:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408095360 00000100:00100000:1.0:1788463223.346286:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408095360 00000100:00100000:1.0:1788463223.346321:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408095104 00000100:00100000:1.0:1788463223.346324:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408095104 00000100:00100000:1.0:1788463223.346342:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408095488 00000100:00100000:1.0:1788463223.346345:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408095488 00000100:00100000:1.0:1788463223.346360:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788463223.346366:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408095360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463223.346404:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408095360:12345-0@lo:400:kworker.0 Request processed in 35us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463223.346565:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788463223.346579:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788463223.346586:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408095104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463223.346615:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408095104:12345-0@lo:400:kworker.0 Request processed in 30us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463223.346621:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788463223.346641:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788463223.346647:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408095488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463223.346676:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408095488:12345-0@lo:400:kworker.0 Request processed in 29us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463223.346708:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788463223.346728:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788463223.346733:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463223.346763:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408095488:0@lo:400:kworker.0 00000100:00100000:1.0:1788463223.346774:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408095104:0@lo:400:kworker.0 00010000:00080000:1.0:1788463223.346789:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4b14000 x1875339408095616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463223.346798:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408095616:0@lo:400:kworker.0 00000100:00100000:2.0:1788463223.347053:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408095360:0@lo:400:kworker.0 00000100:00100000:0.0:1788463223.352273:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408094976:0@lo:400:kworker.0 00010000:00010000:3.0:1788463223.653154:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463223.845006:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463223.845032:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408095744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463223.845128:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463223.845264:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408095744 00000100:00100000:3.0:1788463223.845273:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408095744 00000100:00100000:3.0:1788463223.845323:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788463223.845332:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408095744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463223.845367:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463223.845412:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408095744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463223.845419:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788463223.845510:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4b16680 x1875339408095744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463223.845529:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408095744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463224.520502:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463224.520551:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463224.520592:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463224.520632:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463224.520664:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463224.520743:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395478016 00000100:00100000:1.0:1788463224.520754:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395478016 00000100:00100000:1.0:1788463224.520820:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395478144 00000100:00100000:1.0:1788463224.520825:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395478144 00000100:00100000:1.0:1788463224.520854:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:1.0:1788463224.520864:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395478016:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463224.520964:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395478016:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 101us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463224.520974:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:1.0:1788463224.520996:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00100000:1.0:1788463224.521003:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395478144:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463224.521027:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395478144:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00080000:3.0:1788463224.521258:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463224.521597:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00100000:2.0:1788463224.521731:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395478272 00000100:00100000:2.0:1788463224.521738:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395478272 00000100:00100000:2.0:1788463224.521785:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395478400 00000100:00100000:2.0:1788463224.521788:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395478400 00000100:00100000:2.0:1788463224.521811:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:2.0:1788463224.521819:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395478272:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463224.521871:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395478272:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 53us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463224.521878:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:2.0:1788463224.521890:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:2.0:1788463224.521896:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395478400:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463224.521917:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395478400:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 22us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463224.521924:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00080000:3.0:1788463224.522118:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463224.522122:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463224.522920:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395477888 00000100:00100000:0.0:1788463224.522931:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395477888 00000100:00100000:0.0:1788463224.522985:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 225 00000100:00100000:0.0:1788463224.522995:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395477888:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463224.523071:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395477888:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 77us (2478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463224.523080:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 225 00010000:00010000:3.0:1788463224.676956:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463225.703679:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463226.725367:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463227.429268:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408095872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463227.429347:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463227.429560:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408095872 00000100:00100000:2.0:1788463227.429569:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408095872 00000100:00100000:2.0:1788463227.429637:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788463227.429646:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408095872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463227.429715:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463227.429768:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408095872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (420us total) trans 0 rc 0/0 00010000:00080000:0.0:1788463227.429901:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec4adc00 x1875339408095872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463227.429923:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408095872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463227.430003:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788463227.430119:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788463227.749605:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463228.456669:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408096384:0@lo:400:kworker.0 00000100:00100000:3.0:1788463228.456946:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408096256:0@lo:400:kworker.0 00000100:00100000:3.0:1788463228.457000:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463228.457482:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463228.457545:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408096256 00000100:00100000:2.0:1788463228.457554:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408096256 00000100:00100000:2.0:1788463228.457599:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463228.457608:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408096256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463228.457675:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408096256:12345-0@lo:400:kworker.0 Request processed in 68us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463228.457718:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788463228.457889:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408096384 00000100:00100000:3.0:1788463228.457894:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408096384 00000100:00100000:3.0:1788463228.457943:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788463228.457951:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408096384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463228.458005:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408096384:12345-0@lo:400:kworker.0 Request processed in 55us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463228.458012:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788463228.458031:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463228.458117:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408096000:0@lo:400:kworker.0 00000100:00100000:0.0:1788463228.458163:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463228.458199:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408096512:0@lo:400:kworker.0 00000100:00100000:0.0:1788463228.458220:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463228.458241:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788463228.458246:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408096128:0@lo:400:kworker.0 00000100:00100000:0.0:1788463228.458267:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463228.458285:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408096640:0@lo:400:kworker.0 00000100:00100000:0.0:1788463228.458308:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463228.458334:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408096512 00000100:00100000:0.0:1788463228.458339:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408096512 00000100:00100000:3.0:1788463228.458591:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408096000 00000100:00100000:3.0:1788463228.458596:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408096000 00000100:00100000:3.0:1788463228.458632:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788463228.458640:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408096000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463228.458730:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408096000:12345-0@lo:400:kworker.0 Request processed in 43us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463228.458738:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00080000:2.0:1788463228.458881:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec4ad500 x1875339408096256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463228.458904:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408096256:0@lo:400:kworker.0 00000100:00100000:2.0:1788463228.458953:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408096384:0@lo:400:kworker.0 00000100:00100000:2.0:1788463228.458987:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408096640 00000100:00100000:2.0:1788463228.458990:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408096640 00000100:00100000:2.0:1788463228.459023:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788463228.459031:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408096640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463228.459068:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408096640:12345-0@lo:400:kworker.0 Request processed in 38us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463228.459074:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788463228.459511:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408096128 00000100:00100000:0.0:1788463228.459516:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408096128 00000100:00100000:0.0:1788463228.459552:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788463228.459561:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408096512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463228.459596:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408096512:12345-0@lo:400:kworker.0 Request processed in 38us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463228.459603:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788463228.459616:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788463228.459622:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408096128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463228.459649:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408096128:12345-0@lo:400:kworker.0 Request processed in 28us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463228.459655:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788463228.459680:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463228.459710:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463228.459733:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408096128:0@lo:400:kworker.0 00010000:00080000:0.0:1788463228.459768:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec4ac000 x1875339408096640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463228.460085:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408096640:0@lo:400:kworker.0 00000100:00100000:0.0:1788463228.460101:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408096000:0@lo:400:kworker.0 00000100:00100000:0.0:1788463228.460111:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408096512:0@lo:400:kworker.0 00010000:00010000:2.0:1788463228.774259:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463228.964973:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463228.964996:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408096768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463228.965068:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463228.965506:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408096768 00000100:00100000:3.0:1788463228.965515:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408096768 00000100:00100000:3.0:1788463228.965568:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463228.965591:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408096768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463228.965628:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463228.965716:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408096768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463228.965724:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788463228.965925:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4b16a00 x1875339408096768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463228.966015:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408096768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463229.641815:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463229.641860:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463229.641877:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395478528 00000100:00100000:2.0:1788463229.641890:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395478528 00000100:00100000:3.0:1788463229.641917:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463229.641961:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463229.641968:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 227 00000100:00100000:2.0:1788463229.641986:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395478528:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463229.642073:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395478528:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463229.642080:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 227 00000100:00100000:2.0:1788463229.642125:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395479040 00000100:00100000:2.0:1788463229.642129:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395479040 00000100:00100000:2.0:1788463229.642169:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:2.0:1788463229.642174:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395479040:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463229.642204:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395479040:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463229.642210:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00080000:2.0:1788463229.642358:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463229.646768:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463229.646816:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395478912 00000100:00100000:3.0:1788463229.646829:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395478912 00000100:00100000:3.0:1788463229.648200:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:3.0:1788463229.648222:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395478912:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463229.648392:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395478912:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 178us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463229.648401:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00080000:3.0:1788463229.648437:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463229.649571:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395478784 00000100:00100000:1.0:1788463229.649584:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395478784 00000100:00100000:1.0:1788463229.649653:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395478656 00000100:00100000:1.0:1788463229.649658:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395478656 00000100:00100000:1.0:1788463229.649697:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 81 00000100:00100000:1.0:1788463229.649707:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395478784:12345-192.168.204.11@tcp:400:kworker.0 00000100:00080000:3.0:1788463229.649736:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463229.649773:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395478784:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 67us (7912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463229.649780:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 81 00000100:00100000:1.0:1788463229.649797:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 82 00000100:00100000:1.0:1788463229.649802:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395478656:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463229.649824:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395478656:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 22us (7864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463229.649830:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 82 00010000:00010000:3.0:1788463229.805361:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463230.821130:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463231.844856:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463232.554617:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408096896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463232.554735:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463232.555097:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408096896 00000100:00100000:2.0:1788463232.555106:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408096896 00000100:00100000:2.0:1788463232.555290:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788463232.555303:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408096896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463232.555344:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463232.555410:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408096896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463232.555416:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788463232.555887:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4b17480 x1875339408096896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463232.555916:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408096896:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463232.558019:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788463232.874066:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463233.575293:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408097280:0@lo:400:kworker.0 00000100:00100000:3.0:1788463233.575436:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463233.575521:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463233.575529:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408097408:0@lo:400:kworker.0 00000100:00100000:3.0:1788463233.575561:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463233.575598:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408097280 00000100:00100000:3.0:1788463233.575609:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408097280 00000100:00100000:3.0:1788463233.575675:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788463233.575718:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408097280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463233.575802:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408097280:12345-0@lo:400:kworker.0 Request processed in 87us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.575813:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788463233.575851:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408097408 00000100:00100000:3.0:1788463233.575891:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408097408 00000100:00100000:3.0:1788463233.575948:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788463233.575956:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408097408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463233.575995:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408097408:12345-0@lo:400:kworker.0 Request processed in 42us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.576002:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788463233.576027:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463233.576073:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408097408:0@lo:400:kworker.0 00010000:00080000:3.0:1788463233.576091:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4b14700 x1875339408097280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463233.576103:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408097280:0@lo:400:kworker.0 00000100:00100000:2.0:1788463233.576528:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408097152:0@lo:400:kworker.0 00000100:00100000:2.0:1788463233.576583:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463233.576608:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408097664:0@lo:400:kworker.0 00000100:00100000:2.0:1788463233.576633:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463233.576652:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788463233.576658:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408097024:0@lo:400:kworker.0 00000100:00100000:2.0:1788463233.576703:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463233.576737:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408097536:0@lo:400:kworker.0 00000100:00100000:3.0:1788463233.576877:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408097152 00000100:00100000:3.0:1788463233.576885:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408097152 00000100:00100000:3.0:1788463233.576930:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788463233.576940:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408097152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463233.576983:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408097152:12345-0@lo:400:kworker.0 Request processed in 45us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.576990:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788463233.577011:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408097664 00000100:00100000:3.0:1788463233.577015:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408097664 00000100:00100000:3.0:1788463233.577053:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788463233.577059:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408097664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463233.577092:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408097664:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.577098:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788463233.577124:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463233.577210:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463233.577253:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408097152:0@lo:400:kworker.0 00010000:00080000:2.0:1788463233.577266:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4b17800 x1875339408097664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463233.577278:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408097664:0@lo:400:kworker.0 00000100:00100000:2.0:1788463233.577310:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408097024 00000100:00100000:2.0:1788463233.577314:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408097024 00000100:00100000:2.0:1788463233.577345:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788463233.577351:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408097024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463233.577466:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408097024:12345-0@lo:400:kworker.0 Request processed in 114us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463233.577474:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788463233.577526:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408097024:0@lo:400:kworker.0 00000100:00100000:3.0:1788463233.577882:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408097536 00000100:00100000:3.0:1788463233.577887:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408097536 00000100:00100000:3.0:1788463233.577972:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788463233.577981:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408097536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463233.578027:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408097536:12345-0@lo:400:kworker.0 Request processed in 47us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463233.578034:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788463233.578088:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463233.578245:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408097536:0@lo:400:kworker.0 00010000:00010000:3.0:1788463233.892983:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463234.087076:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463234.087108:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408097792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463234.087397:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463234.087485:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408097792 00000100:00100000:0.0:1788463234.087493:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408097792 00000100:00100000:0.0:1788463234.087551:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463234.087561:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408097792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463234.087617:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463234.087667:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408097792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463234.087675:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788463234.089450:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec71d180 x1875339408097792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463234.089491:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408097792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463234.770383:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463234.770455:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463234.770489:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463234.770526:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395479296 00000100:00100000:3.0:1788463234.770536:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395479296 00000100:00100000:3.0:1788463234.770601:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395479424 00000100:00100000:3.0:1788463234.770605:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395479424 00000100:00100000:3.0:1788463234.770632:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00100000:3.0:1788463234.770643:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395479296:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463234.770818:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395479296:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 177us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463234.770826:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00100000:3.0:1788463234.770856:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 87 00000100:00100000:3.0:1788463234.770863:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395479424:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463234.770889:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395479424:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463234.770895:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 87 00000100:00100000:2.0:1788463234.771246:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395479168 00000100:00100000:2.0:1788463234.771253:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395479168 00000100:00100000:2.0:1788463234.771300:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 229 00000100:00100000:2.0:1788463234.771308:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395479168:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463234.771346:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395479168:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 40us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463234.771353:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 229 00000100:00080000:2.0:1788463234.771387:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463234.782152:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463234.782255:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463234.790943:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395479552 00000100:00100000:2.0:1788463234.790961:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395479552 00000100:00100000:2.0:1788463234.791371:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395479680 00000100:00100000:2.0:1788463234.791388:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395479680 00000100:00080000:1.0:1788463234.791604:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463234.791611:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463234.792446:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:2.0:1788463234.792460:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2353:x1875339395479552:12345-192.168.204.11@tcp:9:kworker.0 00000020:00000080:2.0:1788463234.792493:0:8660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35a37 00000100:00080000:2.0:1788463234.792503:0:8660:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec404000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788463234.792558:0:8660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788463234.794958:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:3.0:1788463234.794980:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2353:x1875339395479680:12345-192.168.204.11@tcp:9:kworker.0 00000020:00000080:3.0:1788463234.795016:0:6667:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35a3e 00000100:00080000:3.0:1788463234.795029:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec406800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463234.795085:0:6667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788463234.795606:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463234.795613:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463234.796640:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+2:2353:x1875339395479680:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 1655us (14371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463234.796654:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:2.0:1788463234.797486:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+2:2353:x1875339395479552:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 5025us (15348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463234.797496:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00010000:00010000:3.0:1788463234.920988:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463235.942363:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788463236.730418:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0abe103f-aa34-4171-b132-f3b0f4fb1586 00000020:00000080:1.0:1788463236.730430:0:6697:0:(genops.c:885:class_export_put()) final put ffff9ba5ec400000/0abe103f-aa34-4171-b132-f3b0f4fb1586 00000020:00000080:1.0:1788463236.730463:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5ec400000/0abe103f-aa34-4171-b132-f3b0f4fb1586 for lustre-OST0000 00000020:00000080:1.0:1788463236.730515:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5ec404000 for lustre-OST0000 00000001:00100000:2.0:1788463236.746532:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0abe103f-aa34-4171-b132-f3b0f4fb1586 00000020:00000080:2.0:1788463236.746542:0:7636:0:(genops.c:885:class_export_put()) final put ffff9ba5ec403800/0abe103f-aa34-4171-b132-f3b0f4fb1586 00000020:00000080:0.0:1788463236.746614:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5ec403800/0abe103f-aa34-4171-b132-f3b0f4fb1586 for lustre-OST0001 00000020:00000080:0.0:1788463236.746672:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5ec406800 for lustre-OST0001 00010000:00010000:3.0:1788463236.967516:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463237.670505:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463237.670528:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408097920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463237.670605:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463237.671145:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408097920 00000100:00100000:1.0:1788463237.671155:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408097920 00000100:00100000:1.0:1788463237.671229:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788463237.671239:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408097920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463237.671278:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463237.671333:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408097920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463237.671340:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788463237.671542:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788463237.671580:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5bea680 x1875339408097920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463237.671603:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408097920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788463237.989348:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463238.693913:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408098048:0@lo:400:kworker.0 00000100:00100000:0.0:1788463238.693916:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408098432:0@lo:400:kworker.0 00000100:00100000:3.0:1788463238.694440:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408098176:0@lo:400:kworker.0 00000100:00100000:2.0:1788463238.701096:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463238.701242:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463238.701310:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408098688:0@lo:400:kworker.0 00000100:00100000:3.0:1788463238.701344:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463238.701405:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408098176 00000100:00100000:3.0:1788463238.701413:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408098176 00000100:00100000:3.0:1788463238.701468:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788463238.701478:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408098176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463238.701550:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408098176:12345-0@lo:400:kworker.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463238.701557:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788463238.701604:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408098176:0@lo:400:kworker.0 00000100:00100000:3.0:1788463238.701788:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408098304:0@lo:400:kworker.0 00000100:00100000:3.0:1788463238.701840:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463238.702223:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463238.702289:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408098560:0@lo:400:kworker.0 00000100:00100000:2.0:1788463238.702322:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463238.702344:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408098432 00000100:00100000:0.0:1788463238.702352:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408098432 00000100:00100000:2.0:1788463238.702364:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408098688 00000100:00100000:2.0:1788463238.702379:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408098688 00000100:00100000:0.0:1788463238.702410:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408098560 00000100:00100000:0.0:1788463238.702415:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408098560 00000100:00100000:2.0:1788463238.702423:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408098304 00000100:00100000:2.0:1788463238.702428:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408098304 00000100:00100000:0.0:1788463238.702448:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788463238.702459:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408098432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463238.702476:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463238.702486:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408098688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463238.702512:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408098432:12345-0@lo:400:kworker.0 Request processed in 55us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463238.702519:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788463238.702538:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788463238.702542:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408098688:12345-0@lo:400:kworker.0 Request processed in 57us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463238.702550:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408098560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463238.702556:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463238.702578:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788463238.702587:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408098304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463238.702594:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408098560:12345-0@lo:400:kworker.0 Request processed in 47us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463238.702602:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788463238.702627:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408098304:12345-0@lo:400:kworker.0 Request processed in 42us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463238.702633:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788463238.702680:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec71f480 x1875339408098304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463238.702713:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408098304:0@lo:400:kworker.0 00010000:00080000:2.0:1788463238.702744:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec71c700 x1875339408098688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463238.702753:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408098688:0@lo:400:kworker.0 00000100:00080000:0.0:1788463238.703281:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463238.703286:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463238.703314:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408098560:0@lo:400:kworker.0 00000100:00100000:0.0:1788463238.703341:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408098432:0@lo:400:kworker.0 00000100:00100000:3.0:1788463238.710186:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408098048 00000100:00100000:3.0:1788463238.710207:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408098048 00000100:00100000:1.0:1788463238.733306:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788463238.733326:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408098048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463238.733442:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408098048:12345-0@lo:400:kworker.0 Request processed in 123us (32354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463238.733450:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788463238.733547:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408098048:0@lo:400:kworker.0 00010000:00010000:3.0:1788463239.015267:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463239.207959:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463239.208014:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408098816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463239.208126:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463239.208295:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408098816 00000100:00100000:0.0:1788463239.208321:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408098816 00000100:00100000:0.0:1788463239.208428:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788463239.208441:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408098816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463239.208491:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463239.208554:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408098816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463239.208562:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788463239.208628:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec71ce00 x1875339408098816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463239.208654:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408098816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463239.885905:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463239.885965:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463239.885999:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463239.886102:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395479936 00000100:00100000:0.0:1788463239.886112:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395479936 00000100:00100000:0.0:1788463239.886179:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395480064 00000100:00100000:0.0:1788463239.886182:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395480064 00000100:00100000:0.0:1788463239.886208:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 91 00000100:00100000:0.0:1788463239.886218:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395479936:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463239.886293:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395479936:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 76us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463239.886300:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 91 00000100:00100000:0.0:1788463239.886317:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 92 00000100:00100000:0.0:1788463239.886323:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2355:x1875339395480064:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463239.886363:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2355:x1875339395480064:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 40us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463239.886369:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 92 00000100:00080000:3.0:1788463239.886984:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463239.887728:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395479808 00000100:00100000:2.0:1788463239.887749:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395479808 00000100:00100000:2.0:1788463239.887803:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 231 00000100:00100000:2.0:1788463239.887813:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2355:x1875339395479808:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463239.887873:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2355:x1875339395479808:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 62us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463239.887896:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 231 00010000:00010000:3.0:1788463240.037039:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463241.062170:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463241.121108:0:11017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788463242.085134:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463242.793863:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408098944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463242.793955:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463242.798978:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408098944 00000100:00100000:2.0:1788463242.799004:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408098944 00000100:00100000:2.0:1788463242.799115:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788463242.799131:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408098944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463242.799193:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788463242.799495:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463242.803365:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408098944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4227us (9398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463242.803379:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788463242.814851:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec4ad180 x1875339408098944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463242.814889:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408098944:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463243.113412:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463243.815246:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408099456:0@lo:400:kworker.0 00000100:00100000:3.0:1788463243.815327:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463243.815391:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463243.815417:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408099328:0@lo:400:kworker.0 00000100:00100000:3.0:1788463243.815964:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463243.816219:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408099456 00000100:00100000:3.0:1788463243.816230:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408099456 00000100:00100000:3.0:1788463243.816303:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788463243.816316:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408099456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463243.816381:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408099456:12345-0@lo:400:kworker.0 Request processed in 69us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463243.816388:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788463243.816749:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463243.816785:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408099456:0@lo:400:kworker.0 00000100:00100000:2.0:1788463243.817321:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408099072:0@lo:400:kworker.0 00000100:00100000:2.0:1788463243.817404:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463243.817445:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408099072 00000100:00100000:0.0:1788463243.817455:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408099072 00000100:00100000:2.0:1788463243.817459:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408099584:0@lo:400:kworker.0 00000100:00100000:2.0:1788463243.817494:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463243.817508:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788463243.817520:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408099072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463243.817524:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788463243.817534:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408099200:0@lo:400:kworker.0 00000100:00100000:2.0:1788463243.817572:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463243.817582:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408099072:12345-0@lo:400:kworker.0 Request processed in 65us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463243.817592:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788463243.817596:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408099712:0@lo:400:kworker.0 00000100:00100000:2.0:1788463243.817628:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463243.817668:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408099328 00000100:00100000:0.0:1788463243.817673:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408099328 00000100:00100000:2.0:1788463243.817677:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408099072:0@lo:400:kworker.0 00000100:00100000:0.0:1788463243.817739:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408099712 00000100:00100000:0.0:1788463243.817743:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408099712 00000100:00080000:3.0:1788463243.817790:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463243.827185:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788463243.827209:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408099328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463243.827321:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408099328:12345-0@lo:400:kworker.0 Request processed in 121us (11358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463243.827329:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788463243.827379:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee03480 x1875339408099328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463243.827397:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408099328:0@lo:400:kworker.0 00000100:00100000:0.0:1788463243.827436:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788463243.827444:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408099712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463243.827483:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408099712:12345-0@lo:400:kworker.0 Request processed in 41us (9856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463243.827498:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788463243.829856:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408099584 00000100:00100000:1.0:1788463243.829871:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408099584 00000100:00100000:1.0:1788463243.829949:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408099200 00000100:00100000:1.0:1788463243.829952:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408099200 00000100:00100000:1.0:1788463243.829975:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788463243.829984:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408099584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463243.830076:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408099584:12345-0@lo:400:kworker.0 Request processed in 93us (12581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463243.830084:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788463243.830119:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788463243.830125:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408099200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463243.830158:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408099200:12345-0@lo:400:kworker.0 Request processed in 33us (12586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463243.830163:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788463243.830186:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463243.832899:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408099200:0@lo:400:kworker.0 00010000:00080000:2.0:1788463243.832922:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee00700 x1875339408099712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463243.832934:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408099712:0@lo:400:kworker.0 00000100:00100000:2.0:1788463243.832967:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408099584:0@lo:400:kworker.0 00010000:00010000:3.0:1788463244.137267:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463244.325098:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463244.325127:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408099840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463244.325212:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463244.325292:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408099840 00000100:00100000:0.0:1788463244.325302:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408099840 00000100:00100000:0.0:1788463244.325362:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788463244.325372:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408099840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463244.325414:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463244.325474:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408099840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463244.325481:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788463244.325614:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec71ce00 x1875339408099840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463244.325634:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408099840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463245.005603:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463245.005670:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463245.005724:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463245.005758:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395480192 00000100:00100000:0.0:1788463245.005771:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395480192 00000100:00100000:0.0:1788463245.005826:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 233 00000100:00100000:0.0:1788463245.005837:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395480192:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463245.005908:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395480192:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 73us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463245.005917:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 233 00000100:00100000:0.0:1788463245.005952:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395480320 00000100:00100000:0.0:1788463245.005956:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395480320 00000100:00100000:0.0:1788463245.006373:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395480448 00000100:00100000:0.0:1788463245.006378:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395480448 00000100:00100000:2.0:1788463245.010211:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 96 00000100:00100000:2.0:1788463245.010244:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395480320:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463245.010379:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395480320:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 152us (4785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.010388:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 96 00000100:00100000:2.0:1788463245.010413:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 97 00000100:00100000:2.0:1788463245.010420:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395480448:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463245.010460:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395480448:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 25us (4721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.010466:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 97 00000100:00080000:0.0:1788463245.013538:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788463245.158065:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788463245.460330:0:11167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6879ea70 20000000:00000080:0.0:1788463245.460354:0:11167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ba5ec48f800 uarg=0000000000000000 20000000:01000000:0.0:1788463245.460404:0:11167:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788463245.460421:0:11167:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788463245.460427:0:11167:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788463245.461781:0:11168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788463245.461961:0:11167:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788463245.467112:0:11167:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788463245.467238:0:11167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.467262:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba4c56b1e00/0xc3fe72277ee359ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce8 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.467376:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee359f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee359f1 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.467385:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee359ff expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.467393:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee35a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35a0d expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.467401:0:11167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba4c56b1600/0xc3fe72277ee35a29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd20 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.467430:0:11167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.467478:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba4c56b1600/0xc3fe72277ee35a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd20 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.467497:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba4c56b1600/0xc3fe72277ee35a29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd20 expref: 12 pid: 5810 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463245.467513:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875339408099968:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463245.468050:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee35a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35a0d expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.468064:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee35a14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35a0d expref: 18 pid: 5810 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463245.468077:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875339408100096:0@lo:104: 00000100:00100000:3.0:1788463245.468127:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463245.468305:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408100096 00000100:00100000:1.0:1788463245.468314:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408100096 00010000:00010000:3.0:1788463245.468322:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee359ff expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.468330:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee359ff expref: 18 pid: 5809 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463245.468337:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee02d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875339408100224:0@lo:104: 00000100:00100000:1.0:1788463245.468380:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463245.468390:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+3:11167:x1875339408100096:12345-0@lo:104: 00010000:00010000:1.0:1788463245.468404:0:6681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463245.468543:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788463245.468551:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+3:11167:x1875339408100096:12345-0@lo:104: Request processed in 162us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463245.468559:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788463245.468573:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463245.468580:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.468588:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cb800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1788463245.468593:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.468603:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463245.468610:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463245.468644:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788463245.468707:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.468715:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463245.468740:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.468748:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35a0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a14 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.468764:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463245.468766:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463245.468768:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463245.468780:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408100352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463245.468813:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.468851:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408100352 00000100:00100000:2.0:1788463245.468855:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408100352 00010000:00010000:2.0:1788463245.468876:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee35a14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35a0d expref: 19 pid: 5810 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463245.468899:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463245.468907:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c8993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408100352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463245.468917:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463245.468922:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee35a14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35a0d expref: 19 pid: 5810 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.468932:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee35a14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35a0d expref: 19 pid: 5810 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.468955:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463245.469080:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463245.469123:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee359f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee359f1 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469148:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee359f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee359f1 expref: 19 pid: 5811 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463245.469157:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875339408100480:0@lo:104: 00000100:00100000:3.0:1788463245.469184:0:11167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463245.469210:0:11167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba4c56b1e00/0xc3fe72277ee359ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce8 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469219:0:11167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba4c56b1e00/0xc3fe72277ee359ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce8 expref: 12 pid: 5810 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463245.469228:0:11167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875339408100608:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463245.469266:0:11167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0485300 going to sleep for 11 seconds 00010000:00010000:3.0:1788463245.469287:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cac00/0xc3fe72277ee35a14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35a0d expref: 19 pid: 5810 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463245.469297:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875339408100096:0@lo:104: 00000100:00100000:3.0:1788463245.469333:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408100224 00000100:00100000:3.0:1788463245.469338:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408100224 00000100:00100000:3.0:1788463245.469365:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408100480 00000100:00100000:3.0:1788463245.469368:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408100480 00000100:00100000:3.0:1788463245.469379:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463245.469386:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+4:11167:x1875339408100224:12345-0@lo:104: 00010000:00010000:3.0:1788463245.469396:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469435:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788463245.469447:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+4:11167:x1875339408100224:12345-0@lo:104: Request processed in 61us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463245.469454:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463245.469469:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463245.469474:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:11167:x1875339408100480:12345-0@lo:104: 00010000:00010000:3.0:1788463245.469482:0:5800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469528:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788463245.469534:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+3:11167:x1875339408100480:12345-0@lo:104: Request processed in 60us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463245.469540:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788463245.469561:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463245.469566:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469574:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8ca600 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1788463245.469577:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469586:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463245.469594:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463245.469601:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788463245.469620:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469650:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463245.469666:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469673:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca600/0xc3fe72277ee359ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a06 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469711:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463245.469715:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469722:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1788463245.469724:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469730:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463245.469736:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463245.469741:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788463245.469754:0:5805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469760:0:5805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463245.469766:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469772:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0200/0xc3fe72277ee359f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee359f8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.469791:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463245.469793:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463245.469794:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463245.469802:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463245.469826:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee02d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875339408100224:0@lo:104: 00000100:00100000:3.0:1788463245.469834:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875339408100480:0@lo:104: 00000100:00100000:3.0:1788463245.469859:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408100736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463245.469887:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463245.469916:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463245.469922:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408100864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463245.469941:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463245.470077:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c8993c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:3277:x1875339408100352:12345-0@lo:103:ldlm_bl.0 Request processed in 1170us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.470085:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788463245.470126:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408100736 00000100:00100000:2.0:1788463245.470130:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408100736 00010000:00010000:2.0:1788463245.470145:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee359ff expref: 18 pid: 5809 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463245.470163:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408100864 00000100:00100000:2.0:1788463245.470165:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408100864 00010000:00010000:2.0:1788463245.470175:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee359f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee359f1 expref: 19 pid: 5811 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463245.470187:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788463245.470193:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408100736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463245.470203:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463245.470209:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee359ff expref: 19 pid: 5809 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.470219:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee359ff expref: 19 pid: 5809 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.470231:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee359ff expref: 19 pid: 5809 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.470242:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463245.470270:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:3278:x1875339408100736:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.470286:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788463245.470298:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463245.470304:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:3278:x1875339408100864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463245.470311:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463245.470316:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee359f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee359f1 expref: 17 pid: 5811 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.470323:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee359f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee359f1 expref: 17 pid: 5811 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.470332:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee359f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee359f1 expref: 17 pid: 5811 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.470340:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463245.470362:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3278:x1875339408100864:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.470367:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788463245.470392:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408100864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463245.470400:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408100736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463245.470505:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408100352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463245.474152:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875339408099968:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463245.474169:0:11167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11167:1875339408100608:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463245.474214:0:11167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463245.475369:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463245.475411:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463245.475481:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395480704 00000100:00100000:2.0:1788463245.475491:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395480704 00010000:00010000:2.0:1788463245.475539:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba4c56b1e00/0xc3fe72277ee359ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce8 expref: 13 pid: 5810 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463245.475578:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395480576 00000100:00100000:2.0:1788463245.475582:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395480576 00010000:00010000:2.0:1788463245.475595:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba4c56b1600/0xc3fe72277ee35a29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd20 expref: 14 pid: 5810 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463245.475659:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:2.0:1788463245.475672:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+14:2355:x1875339395480704:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463245.475713:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463245.475720:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba4c56b1e00/0xc3fe72277ee359ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce8 expref: 14 pid: 5810 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475731:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba4c56b1e00/0xc3fe72277ee359ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce8 expref: 14 pid: 5810 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475749:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b1e00/0xc3fe72277ee359ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce8 expref: 14 pid: 5810 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475764:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463245.475812:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2355:x1875339395480704:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 143us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.475820:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:2.0:1788463245.475838:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:2.0:1788463245.475846:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:2355:x1875339395480576:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463245.475854:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463245.475859:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba4c56b1600/0xc3fe72277ee35a29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd20 expref: 12 pid: 5810 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475869:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba4c56b1600/0xc3fe72277ee35a29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd20 expref: 12 pid: 5810 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475880:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b1600/0xc3fe72277ee35a29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd20 expref: 12 pid: 5810 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475899:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475908:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475922:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475929:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475937:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475943:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475951:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463245.475956:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475965:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475978:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463245.475988:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463245.476009:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:2355:x1875339395480576:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 164us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463245.476021:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 29 00010000:00010000:3.0:1788463245.476125:0:11167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.476134:0:11167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463245.476141:0:11167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a45 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463246.184871:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788463246.629383:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788463246.629393:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba4c5230000 from 7 10000000:01000000:1.0:1788463246.629400:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463246.629462:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463246.629480:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463246.629497:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463246.629548:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408100992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463246.629664:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463246.629743:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463246.629812:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408100992 00000100:00100000:2.0:1788463246.629820:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408100992 00000100:00100000:2.0:1788463246.629885:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788463246.629896:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408100992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463246.629913:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463246.629929:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee35a53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35a4c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463246.629967:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee35a53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35a4c expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463246.629981:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee35a53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35a4c expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463246.629992:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cb600, rc 0) 00000100:00100000:2.0:1788463246.630038:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408100992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463246.630045:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788463246.630795:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408100992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463246.630814:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463246.630825:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463246.630891:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463246.630926:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463246.631080:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408101120 00000100:00100000:2.0:1788463246.631086:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408101120 00000100:00100000:2.0:1788463246.631117:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788463246.631124:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408101120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463246.631381:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408101120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463246.631388:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788463246.631502:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed600 going to sleep for 11 seconds 00000100:00100000:1.0:1788463246.631515:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463246.631545:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463246.631584:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463246.631616:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463246.631674:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408101248 00000100:00100000:2.0:1788463246.631714:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408101248 00000100:00100000:2.0:1788463246.631738:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788463246.631744:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408101248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463246.631898:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408101248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463246.631906:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788463246.632355:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788463246.638735:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788463246.640021:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788463246.640051:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463246.640063:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463246.640076:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463246.640087:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463246.640090:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c2e32800 from 7 10000000:01000000:2.0:1788463246.640093:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463246.640138:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463246.640148:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463246.640353:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463246.640383:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec4ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463246.641259:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463246.641416:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463246.648771:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408101376 00000100:00100000:3.0:1788463246.648789:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408101376 00000100:00100000:3.0:1788463246.648852:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788463246.648863:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408101376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463246.648884:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463246.648904:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35a5a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463246.648935:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35a5a expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463246.648947:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35a5a expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463246.648968:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0800, rc 0) 00000100:00100000:3.0:1788463246.649058:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408101376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (7899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463246.649065:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788463246.649481:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec4ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463246.649527:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463246.649540:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463246.649641:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463246.649681:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463246.649737:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec42f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463246.650317:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408101504 00000100:00100000:2.0:1788463246.650340:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408101504 00000100:00100000:2.0:1788463246.650399:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788463246.650409:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408101504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463246.650811:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408101504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 403us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463246.650820:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788463246.651598:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463246.651676:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463246.651784:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463246.651825:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec42f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463246.652234:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408101632 00000100:00100000:3.0:1788463246.652243:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408101632 00000100:00100000:3.0:1788463246.652309:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788463246.652319:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408101632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463246.652533:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408101632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463246.652542:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788463246.653751:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463246.663862:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788463246.666429:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788463246.666466:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463246.666480:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463246.666495:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463246.666508:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788463246.666511:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c88d5800 from 7 10000000:01000000:1.0:1788463246.666515:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788463246.666562:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463246.666570:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463246.666581:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463246.666628:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463246.666964:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463246.667029:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408101760 00000100:00100000:3.0:1788463246.667039:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408101760 00000100:00100000:1.0:1788463246.667083:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed600 going to sleep for 11 seconds 00000100:00100000:3.0:1788463246.667098:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788463246.667109:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408101760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463246.667136:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463246.667151:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b0200/0xc3fe72277ee35a6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35a68 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463246.667191:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b0200/0xc3fe72277ee35a6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35a68 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463246.667204:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b0200/0xc3fe72277ee35a6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35a68 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463246.667213:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0200, rc 0) 00000100:00100000:3.0:1788463246.667255:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408101760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463246.667262:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788463246.669568:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463246.669598:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463246.669626:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463246.673108:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463246.673330:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463246.673373:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed600 going to sleep for 11 seconds 00000100:00100000:0.0:1788463246.677334:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408101888 00000100:00100000:0.0:1788463246.677355:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408101888 00000100:00100000:0.0:1788463246.677434:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788463246.677447:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408101888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463246.677903:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408101888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 458us (4571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463246.677920:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788463246.678799:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408101888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463246.678858:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408102016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463246.678906:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463246.678940:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed600 going to sleep for 11 seconds 00000100:00100000:0.0:1788463246.679242:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408102016 00000100:00100000:0.0:1788463246.679249:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408102016 00000100:00100000:0.0:1788463246.679306:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788463246.679316:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408102016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463246.682679:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408102016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3354us (3762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463246.682710:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788463246.683283:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5bea680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408102016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463246.684307:0:11193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788463246.684925:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788463246.684949:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788463246.684962:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463246.684986:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463246.995947:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463247.000574:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395480832 00000100:00100000:3.0:1788463247.000617:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395480832 00000100:00100000:3.0:1788463247.000891:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 243 00000100:00100000:3.0:1788463247.000905:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:5596:x1875339395480832:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463247.000932:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463247.000959:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee35a76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd4a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463247.001001:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee35a76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd4a expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463247.001015:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee35a76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd4a expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463247.001027:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0c00, rc 0) 00000100:00100000:3.0:1788463247.001141:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395480832:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 238us (5213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463247.001149:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 243 00000100:00100000:1.0:1788463247.006736:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463247.007049:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395480960 00000100:00100000:3.0:1788463247.007064:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395480960 00000100:00100000:3.0:1788463247.007131:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 244 00000100:00100000:3.0:1788463247.007142:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395480960:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463247.007651:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395480960:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 509us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463247.007668:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 244 00000100:00100000:2.0:1788463247.010284:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463247.010442:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395481088 00000100:00100000:1.0:1788463247.010460:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395481088 00000100:00100000:1.0:1788463247.010553:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 245 00000100:00100000:1.0:1788463247.010568:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395481088:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463247.010987:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395481088:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 420us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463247.010997:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 245 00000100:00100000:1.0:1788463247.018187:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463247.018421:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395481216 00000100:00100000:3.0:1788463247.018437:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395481216 00000100:00100000:3.0:1788463247.018512:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 246 00000100:00100000:3.0:1788463247.018526:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395481216:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463247.018551:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463247.018581:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee35a7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd51 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463247.018648:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee35a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd51 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463247.018673:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee35a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd51 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463247.019851:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0a00, rc 0) 00000100:00100000:3.0:1788463247.020074:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:5596:x1875339395481216:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 1546us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463247.020097:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 246 00000100:00100000:1.0:1788463247.032085:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463247.032166:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395481344 00000100:00100000:3.0:1788463247.032179:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395481344 00000100:00100000:3.0:1788463247.032257:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 247 00000100:00100000:3.0:1788463247.032269:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:5596:x1875339395481344:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463247.033107:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:5596:x1875339395481344:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 831us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463247.033120:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 247 00000100:00100000:0.0:1788463247.047811:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463247.048031:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395481472 00000100:00100000:2.0:1788463247.048045:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395481472 00000100:00100000:2.0:1788463247.048118:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 248 00000100:00100000:2.0:1788463247.048130:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:5596:x1875339395481472:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463247.048555:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:5596:x1875339395481472:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 424us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463247.048565:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 248 00010000:00010000:2.0:1788463247.204937:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463247.910601:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463247.910631:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408102144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463247.910779:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463247.910914:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408102144 00000100:00100000:0.0:1788463247.910926:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408102144 00000100:00100000:0.0:1788463247.911051:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788463247.911067:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408102144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463247.911115:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463247.911203:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408102144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463247.911233:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788463247.911260:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788463247.911305:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec71ce00 x1875339408102144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463247.911330:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408102144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463248.229729:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463248.932920:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408102272:0@lo:400:kworker.0 00000100:00100000:1.0:1788463248.933021:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463248.933207:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463248.933214:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408102656:0@lo:400:kworker.0 00000100:00100000:1.0:1788463248.933262:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463248.933311:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408102272 00000100:00100000:1.0:1788463248.933319:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408102272 00000100:00100000:1.0:1788463248.933364:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788463248.933374:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408102272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463248.933429:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408102272:12345-0@lo:400:kworker.0 Request processed in 56us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463248.933436:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788463248.933469:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408102656 00000100:00100000:1.0:1788463248.933472:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408102656 00000100:00100000:1.0:1788463248.933509:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788463248.933516:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408102656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463248.933549:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408102656:12345-0@lo:400:kworker.0 Request processed in 33us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463248.933555:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788463248.933590:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463248.933621:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408102656:0@lo:400:kworker.0 00000100:00100000:1.0:1788463248.933632:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408102272:0@lo:400:kworker.0 00000100:00100000:2.0:1788463248.937831:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408102400:0@lo:400:kworker.0 00000100:00100000:2.0:1788463248.938016:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463248.938081:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463248.938089:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408102528:0@lo:400:kworker.0 00000100:00100000:2.0:1788463248.938121:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463248.938232:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408102400 00000100:00100000:1.0:1788463248.938313:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408102400 00000100:00100000:1.0:1788463248.938374:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788463248.938384:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408102400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463248.938446:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408102400:12345-0@lo:400:kworker.0 Request processed in 64us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463248.938454:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788463248.938499:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408102400:0@lo:400:kworker.0 00000100:00100000:0.0:1788463248.938740:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408102528 00000100:00100000:0.0:1788463248.938745:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408102528 00000100:00100000:0.0:1788463248.938775:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463248.938782:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408102528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463248.938824:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408102528:12345-0@lo:400:kworker.0 Request processed in 42us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463248.938830:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788463248.939091:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee00000 x1875339408102528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463248.939114:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408102528:0@lo:400:kworker.0 00000100:00100000:2.0:1788463248.939443:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463248.939503:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463248.939516:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408102912:0@lo:400:kworker.0 00000100:00100000:3.0:1788463248.939554:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463248.940750:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408102912 00000100:00100000:3.0:1788463248.940763:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408102912 00000100:00100000:3.0:1788463248.940828:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788463248.940838:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408102912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463248.940914:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408102912:12345-0@lo:400:kworker.0 Request processed in 77us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463248.941001:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788463248.941046:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee00700 x1875339408102912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463248.941059:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408102912:0@lo:400:kworker.0 00000100:00080000:1.0:1788463248.941159:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463248.944483:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408102784:0@lo:400:kworker.0 00000100:00100000:2.0:1788463248.944576:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463248.944722:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408102784 00000100:00100000:0.0:1788463248.944731:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408102784 00000100:00100000:0.0:1788463248.944795:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788463248.944806:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408102784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463248.944868:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408102784:12345-0@lo:400:kworker.0 Request processed in 64us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463248.944875:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788463248.945020:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463248.945101:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408102784:0@lo:400:kworker.0 00010000:00010000:3.0:1788463249.253114:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463249.446107:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408103040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463249.446205:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463249.446606:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408103040 00000100:00100000:0.0:1788463249.446616:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408103040 00000100:00100000:0.0:1788463249.446720:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788463249.446731:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408103040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463249.446778:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463249.446844:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408103040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463249.446859:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788463249.446933:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec71ce00 x1875339408103040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463249.446953:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408103040:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788463249.959149:0:11364:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788463250.128320:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463250.128372:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463250.128402:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463250.128442:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395481856 00000100:00100000:0.0:1788463250.128453:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395481856 00000100:00100000:0.0:1788463250.128520:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395481728 00000100:00100000:0.0:1788463250.128523:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395481728 00000100:00100000:0.0:1788463250.128560:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 101 00000100:00100000:0.0:1788463250.128572:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2356:x1875339395481856:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463250.128661:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2356:x1875339395481856:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.128669:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 101 00000100:00100000:0.0:1788463250.128721:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 102 00000100:00100000:0.0:1788463250.128729:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395481728:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463250.128755:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395481728:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463250.128762:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 102 00000100:00080000:0.0:1788463250.128784:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463250.129210:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395481600 00000100:00100000:2.0:1788463250.129217:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395481600 00000100:00100000:2.0:1788463250.129266:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 250 00000100:00100000:2.0:1788463250.129274:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2356:x1875339395481600:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463250.129313:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2356:x1875339395481600:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 40us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463250.129319:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 250 00010000:00010000:2.0:1788463250.285953:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463251.301144:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463252.325244:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463253.029009:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408103168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463253.029099:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463253.029289:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408103168 00000100:00100000:3.0:1788463253.029298:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408103168 00000100:00100000:3.0:1788463253.029368:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788463253.029378:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408103168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463253.029415:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463253.029459:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408103168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463253.029465:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788463253.029575:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec71fb80 x1875339408103168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463253.029595:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408103168:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788463253.029741:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788463253.355628:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463254.053199:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408103296:0@lo:400:kworker.0 00000100:00100000:0.0:1788463254.053296:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463254.053968:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408103296 00000100:00100000:2.0:1788463254.053980:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408103296 00000100:00100000:2.0:1788463254.054050:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788463254.054061:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408103296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463254.070972:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408103680:0@lo:400:kworker.0 00000100:00100000:3.0:1788463254.071057:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463254.071228:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463254.071236:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408103808:0@lo:400:kworker.0 00000100:00100000:3.0:1788463254.071262:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463254.078903:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408103296:12345-0@lo:400:kworker.0 Request processed in 24829us (25592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463254.078921:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788463254.079010:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408103680 00000100:00100000:2.0:1788463254.079021:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408103680 00000100:00100000:2.0:1788463254.079086:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408103808 00000100:00100000:2.0:1788463254.079090:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408103808 00000100:00100000:2.0:1788463254.079116:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788463254.079126:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408103680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463254.079211:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408103680:12345-0@lo:400:kworker.0 Request processed in 86us (8154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463254.079217:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788463254.079230:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788463254.079236:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408103808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463254.079268:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408103808:12345-0@lo:400:kworker.0 Request processed in 33us (8005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463254.079273:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788463254.079302:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408103424:0@lo:400:kworker.0 00000100:00100000:2.0:1788463254.079345:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463254.079383:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408103936:0@lo:400:kworker.0 00000100:00100000:2.0:1788463254.079410:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463254.079433:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463254.079440:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408103552:0@lo:400:kworker.0 00000100:00100000:2.0:1788463254.079478:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463254.079546:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408103808:0@lo:400:kworker.0 00000100:00100000:2.0:1788463254.079559:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408103680:0@lo:400:kworker.0 00000100:00100000:2.0:1788463254.079584:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408103936 00000100:00100000:2.0:1788463254.079587:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408103936 00000100:00100000:2.0:1788463254.079613:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408103552 00000100:00100000:2.0:1788463254.079624:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408103552 00000100:00100000:2.0:1788463254.079647:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788463254.079653:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408103936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463254.079721:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408103936:12345-0@lo:400:kworker.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463254.079728:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788463254.079740:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788463254.079747:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408103552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463254.079776:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408103552:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463254.079783:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788463254.079814:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee03800 x1875339408103552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463254.079825:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408103552:0@lo:400:kworker.0 00010000:00080000:2.0:1788463254.079836:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee02a00 x1875339408103936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463254.079843:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408103936:0@lo:400:kworker.0 00000100:00100000:3.0:1788463254.083195:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408103424 00000100:00100000:3.0:1788463254.083213:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408103424 00000100:00100000:3.0:1788463254.083282:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788463254.083293:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408103424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463254.083411:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408103424:12345-0@lo:400:kworker.0 Request processed in 119us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463254.083419:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1788463254.083451:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463254.083471:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463254.083525:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408103424:0@lo:400:kworker.0 00000100:00100000:0.0:1788463254.088278:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408103296:0@lo:400:kworker.0 00000001:02000400:0.0:1788463254.149242:0:11464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:20:52 (1788463252) === 00010000:00010000:3.0:1788463254.380638:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463254.503266:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463254.503399:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395482112 00000100:00100000:1.0:1788463254.503413:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395482112 00000100:00100000:1.0:1788463254.503510:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:1.0:1788463254.503522:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:9682:x1875339395482112:12345-192.168.204.11@tcp:700:mkdir.0 00000100:00100000:1.0:1788463254.503619:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:9682:x1875339395482112:12345-192.168.204.11@tcp:700:mkdir.0 Request processed in 98us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463254.503627:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00080000:3.0:1788463254.504255:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463254.505415:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463254.505582:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395481984 00000100:00100000:0.0:1788463254.505591:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395481984 00000100:00100000:0.0:1788463254.505663:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:0.0:1788463254.505718:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395481984:12345-192.168.204.11@tcp:41:mkdir.0 00000004:00000024:0.0:1788463254.505787:0:5818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788463254.506147:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395481984:12345-192.168.204.11@tcp:41:mkdir.0 Request processed in 473us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463254.506157:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:1.0:1788463254.509145:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463254.509420:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395482368 00000100:00100000:3.0:1788463254.509432:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395482368 00000100:00100000:3.0:1788463254.509515:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:3.0:1788463254.509525:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:9682:x1875339395482368:12345-192.168.204.11@tcp:36:mkdir.0 00010000:00010000:3.0:1788463254.509585:0:8864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463254.509944:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35965 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dcd3 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.509969:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430a00) 00010000:00010000:3.0:1788463254.509981:0:8864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463254.510308:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35a84 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.510321:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35a84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.510331:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35a84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.510363:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.510371:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.510377:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463254.512376:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788463254.512403:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35a84 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.512414:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35a84 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.512421:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35a84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.512426:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463254.512430:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35a84 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.512438:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35a84 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.512537:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58100) 00010000:00010000:3.0:1788463254.512541:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463254.512546:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35a84 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.512552:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35a84 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463254.512576:0:8864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb03e6e9 reply state 000000003a41465e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463254.512585:0:8864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463254.513182:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:9682:x1875339395482368:12345-192.168.204.11@tcp:36:mkdir.0 Request processed in 3652us (4041us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788463254.513193:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00010000:00010000:1.0:1788463254.517539:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.517564:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.517574:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.517580:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463254.517585:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.517654:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.517877:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ba5c5b58200) 00010000:00010000:1.0:1788463254.517899:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463254.517907:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.517915:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee35a8b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463254.524387:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463254.524578:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395482496 00000100:00100000:0.0:1788463254.524589:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395482496 00000100:00100000:0.0:1788463254.524722:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:0.0:1788463254.524734:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:9683:x1875339395482496:12345-192.168.204.11@tcp:101:chmod.0 00010000:00010000:0.0:1788463254.524758:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463254.524868:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0030800/0xc3fe72277ee35a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd58 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.524950:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031400/0xc3fe72277ee35a99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.524967:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031400/0xc3fe72277ee35a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.524980:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031400/0xc3fe72277ee35a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463254.525020:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788463254.525025:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463254.525072:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031400/0xc3fe72277ee35a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.525130:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0030800/0xc3fe72277ee35a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd58 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.525156:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031400/0xc3fe72277ee35a99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd58 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.525177:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519a900) 00010000:00010000:0.0:1788463254.525180:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463254.525184:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0031400, rc 0) 00000100:00100000:0.0:1788463254.525404:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:9683:x1875339395482496:12345-192.168.204.11@tcp:101:chmod.0 Request processed in 671us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463254.525412:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:2.0:1788463254.528503:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463254.528653:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395482752 00000100:00100000:3.0:1788463254.528664:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395482752 00000100:00100000:3.0:1788463254.528919:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:3.0:1788463254.528930:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:9683:x1875339395482752:12345-192.168.204.11@tcp:36:chmod.0 00010000:00010000:3.0:1788463254.529016:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463254.529043:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031400/0xc3fe72277ee35a99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd58 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.529161:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519a900) 00010000:00010000:3.0:1788463254.529176:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463254.529204:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.529217:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.529227:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463254.529536:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089ed899a reply state 00000000c0c8eb8b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463254.529546:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788463254.529553:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788463254.529655:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:9683:x1875339395482752:12345-192.168.204.11@tcp:36:chmod.0 Request processed in 725us (1160us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788463254.529663:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00010000:00010000:1.0:1788463254.532588:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.532607:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.532614:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.532619:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463254.532624:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.532632:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.532650:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58100) 00010000:00010000:1.0:1788463254.532653:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788463254.532658:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.532664:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1c00/0xc3fe72277ee35aa0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463254.567716:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408104064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463254.567796:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463254.569051:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408104064 00000100:00100000:0.0:1788463254.569064:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408104064 00000100:00100000:0.0:1788463254.569131:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788463254.569143:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408104064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463254.569189:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463254.569274:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408104064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463254.569281:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788463254.569502:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec71fb80 x1875339408104064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463254.569536:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408104064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463254.575178:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463254.575285:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395482880 00000100:00100000:0.0:1788463254.575297:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395482880 00000100:00100000:0.0:1788463254.575365:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1788463254.575377:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:9684:x1875339395482880:12345-192.168.204.11@tcp:101:chown.0 00010000:00010000:0.0:1788463254.575408:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463254.575435:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0030800/0xc3fe72277ee35aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd5f expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.575835:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031a00/0xc3fe72277ee35aae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.575851:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031a00/0xc3fe72277ee35aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.575863:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031a00/0xc3fe72277ee35aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463254.575896:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788463254.575900:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463254.575936:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031a00/0xc3fe72277ee35aae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.576243:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0030800/0xc3fe72277ee35aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd5f expref: 9 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.576264:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031a00/0xc3fe72277ee35aae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd5f expref: 8 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.576273:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519ac00) 00010000:00010000:0.0:1788463254.576276:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463254.576279:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c0031a00, rc 0) 00000100:00100000:0.0:1788463254.576405:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:9684:x1875339395482880:12345-192.168.204.11@tcp:101:chown.0 Request processed in 1029us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463254.576413:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:3.0:1788463254.579914:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463254.580101:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395483008 00000100:00100000:0.0:1788463254.580111:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395483008 00000100:00100000:0.0:1788463254.580225:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:0.0:1788463254.580237:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:9684:x1875339395483008:12345-192.168.204.11@tcp:101:chown.0 00010000:00010000:0.0:1788463254.580258:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463254.580281:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031400/0xc3fe72277ee35ab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd66 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580350:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35abc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580364:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580376:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580392:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ac3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580399:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580405:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580509:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35aca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580518:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580525:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463254.580571:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788463254.580575:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463254.580592:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580605:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580611:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35abc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580618:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35abc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580624:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463254.580628:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35abc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580636:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35abc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580650:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519ac00) 00010000:00010000:0.0:1788463254.580653:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463254.580658:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35abc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580665:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35abc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580680:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580742:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580748:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580753:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463254.580756:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580763:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580771:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ba5c519a500) 00010000:00010000:0.0:1788463254.580774:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463254.580777:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ac3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580783:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ac3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580831:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031400/0xc3fe72277ee35ab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd66 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580845:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35aca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd66 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.580852:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5c519a100) 00010000:00010000:0.0:1788463254.580854:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463254.580863:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f000, rc 0) 00000100:00100000:0.0:1788463254.580940:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:9684:x1875339395483008:12345-192.168.204.11@tcp:101:chown.0 Request processed in 705us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463254.582090:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:1.0:1788463254.584964:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463254.585157:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395483264 00000100:00100000:3.0:1788463254.585168:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395483264 00000100:00100000:3.0:1788463254.585239:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:3.0:1788463254.585250:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:9684:x1875339395483264:12345-192.168.204.11@tcp:36:chown.0 00010000:00010000:3.0:1788463254.585317:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463254.585357:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35aca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd66 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.585378:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5c519a100) 00010000:00010000:3.0:1788463254.585389:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463254.585419:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.585432:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.585443:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463254.619339:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788463254.619407:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6a8cda2 reply state 0000000034180972 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463254.619421:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788463254.619435:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788463254.619730:0:8863:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788463254.619746:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:9684:x1875339395483264:12345-192.168.204.11@tcp:36:chown.0 Request processed in 34495us (34803us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788463254.619756:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00010000:00010000:1.0:1788463254.619835:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.619845:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.619853:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.619859:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463254.619866:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.619875:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.619893:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5c5b58100) 00010000:00010000:1.0:1788463254.619896:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788463254.619902:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.619909:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee35ad1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463254.634200:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463254.634307:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395483392 00000100:00100000:0.0:1788463254.634318:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395483392 00000100:00100000:0.0:1788463254.634424:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:0.0:1788463254.634436:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:9685:x1875339395483392:12345-192.168.204.11@tcp:101:touch.500 00010000:00010000:0.0:1788463254.634474:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463254.634495:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd6d expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463254.638070:0:8864:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3524us 00010000:00010000:2.0:1788463254.660856:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35adf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.660884:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.660899:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.660915:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35ae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.660922:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.660929:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.662000:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35aed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.662017:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.662028:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463254.662062:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788463254.662066:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463254.662118:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35aed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.662135:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35adf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.662142:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35adf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.662150:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35adf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.662156:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cae00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463254.663673:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35adf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663714:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35adf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663731:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519ac00) 00010000:00010000:2.0:1788463254.663734:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463254.663740:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663747:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663764:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663770:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663790:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663796:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cb800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463254.663800:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663807:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663815:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ba5d0c1e200) 00010000:00010000:2.0:1788463254.663817:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463254.663820:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35ae6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663826:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35ae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663884:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35ad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd6d expref: 8 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663903:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35aed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd6d expref: 7 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.663910:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5d0c1e600) 00010000:00010000:2.0:1788463254.663913:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788463254.663915:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8ca600, rc 0) 00000100:00100000:2.0:1788463254.663997:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:9685:x1875339395483392:12345-192.168.204.11@tcp:101:touch.500 Request processed in 29561us (29804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463254.664019:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:0.0:1788463254.673094:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463254.673246:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395483648 00000100:00100000:1.0:1788463254.673257:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395483648 00000100:00100000:1.0:1788463254.673351:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:1.0:1788463254.673363:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:9685:x1875339395483648:12345-192.168.204.11@tcp:101:touch.500 00010000:00010000:1.0:1788463254.673387:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463254.673441:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35af4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd74 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.674194:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35afb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.674291:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35afb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.674359:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35afb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.674379:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.674387:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.674394:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463254.676390:0:5818:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788463254.677964:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35b09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.677991:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.678005:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35b09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.678048:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35afb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.678067:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35afb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.678074:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35afb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.678079:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463254.678084:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35afb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.678091:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35afb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.678103:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5d0c1e600) 00010000:00010000:1.0:1788463254.678106:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463254.678110:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35afb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.678116:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35afb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463254.678129:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eab2e909 reply state 000000003a85dbd2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463254.678137:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788463254.678242:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35af4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd74 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.678259:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35b09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd74 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.678278:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ba5d9430300) 00010000:00010000:1.0:1788463254.678281:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463254.678284:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488800, rc 0) 00000100:00100000:1.0:1788463254.678429:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:9685:x1875339395483648:12345-192.168.204.11@tcp:101:touch.500 Request processed in 5067us (5348us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788463254.678438:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:2.0:1788463254.684739:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00010000:00010000:1.0:1788463254.684956:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.684970:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.684978:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.684985:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463254.684990:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.685000:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.685021:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff9ba5d9430400) 00010000:00010000:1.0:1788463254.685024:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463254.685029:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.685035:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463254.685269:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395483904 00000100:00100000:3.0:1788463254.685280:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395483904 00000100:00100000:3.0:1788463254.685373:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:3.0:1788463254.685385:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:9685:x1875339395483904:12345-192.168.204.11@tcp:36:touch.500 00010000:00010000:3.0:1788463254.685472:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463254.685494:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35b09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd74 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.685513:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ba5d9430300) 00010000:00010000:3.0:1788463254.685520:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463254.685568:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.685581:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.685641:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463254.685857:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099fac827 reply state 000000007edc7b04 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463254.685867:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463254.686147:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:9685:x1875339395483904:12345-192.168.204.11@tcp:36:touch.500 Request processed in 762us (1422us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788463254.686155:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:2.0:1788463254.689072:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463254.689566:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395484032 00000100:00100000:3.0:1788463254.689577:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395484032 00000100:00100000:3.0:1788463254.689716:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:3.0:1788463254.689729:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:9685:x1875339395484032:12345-192.168.204.11@tcp:101:touch.500 00010000:00010000:3.0:1788463254.689838:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463254.689871:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35b1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd7b expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.689950:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35b1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd7b expref: 11 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.689968:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35b1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd7b expref: 11 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.690019:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:3.0:1788463254.690023:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463254.690027:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1400, rc 0) 00000100:00100000:3.0:1788463254.690089:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+11:9685:x1875339395484032:12345-192.168.204.11@tcp:101:touch.500 Request processed in 363us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463254.690096:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00010000:00010000:1.0:1788463254.692444:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.692568:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.692576:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.692583:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463254.692588:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.692877:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.692904:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:1.0:1788463254.692909:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463254.692916:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.692924:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463254.697267:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463254.697368:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395484160 00000100:00100000:1.0:1788463254.697380:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395484160 00000100:00100000:1.0:1788463254.697473:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:1.0:1788463254.697483:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875339395484160:12345-192.168.204.11@tcp:8:touch.500 00010000:00080000:1.0:1788463254.697531:0:6665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:1.0:1788463254.697573:0:6665:0:(genops.c:1385:class_connect()) connect: client c87dc105-ebf6-45f0-8943-2a25b33dd5b8, cookie 0xc3fe72277ee35b25 00002000:00100000:1.0:1788463254.697664:0:6665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c87dc105-ebf6-45f0-8943-2a25b33dd5b8/ffff9ba5feab3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788463254.697732:0:6665:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788463254.698037:0:6665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788463254.698084:0:6665:0:(import.c:65:import_set_state_nolock()) ffff9ba5ebffa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463254.698357:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2353:x1875339395484160:12345-192.168.204.11@tcp:8:touch.500 Request processed in 872us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463254.698367:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:2.0:1788463254.701342:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463254.701526:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395484288 00000100:00100000:3.0:1788463254.701539:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395484288 00000100:00100000:3.0:1788463254.701771:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:3.0:1788463254.701784:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:0:x1875339395484288:12345-192.168.204.11@tcp:2:touch.500 00000100:00080000:0.0:1788463254.704417:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788463254.736541:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000001:00080000:3.0:1788463254.736578:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788463254.736986:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:0:x1875339395484288:12345-192.168.204.11@tcp:2:touch.500 Request processed in 35198us (35650us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788463254.736999:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1788463254.741036:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463254.741252:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395484544 00000100:00100000:1.0:1788463254.741264:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395484544 00000100:00100000:1.0:1788463254.741394:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:1.0:1788463254.741409:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:9685:x1875339395484544:12345-192.168.204.11@tcp:35:touch.500 00000100:00100000:1.0:1788463254.742155:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+11:9685:x1875339395484544:12345-192.168.204.11@tcp:35:touch.500 Request processed in 746us (1136us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788463254.742237:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:3.0:1788463254.759488:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463254.759630:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395484672 00000100:00100000:1.0:1788463254.759645:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395484672 00000100:00100000:1.0:1788463254.760092:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:1.0:1788463254.760107:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+11:9686:x1875339395484672:12345-192.168.204.11@tcp:101:rm.0 00010000:00010000:1.0:1788463254.760142:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463254.760360:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd82 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.760455:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35b33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.760473:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.760509:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463254.760555:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788463254.760559:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463254.760619:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.760650:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489800/0xc3fe72277ee35b2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd82 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.760772:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35b33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd82 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.760782:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5d0c1e600) 00010000:00010000:1.0:1788463254.760785:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463254.760788:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489e00, rc 0) 00000100:00100000:1.0:1788463254.761422:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:9686:x1875339395484672:12345-192.168.204.11@tcp:101:rm.0 Request processed in 1316us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463254.761433:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:0.0:1788463254.765765:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463254.765898:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395484928 00000100:00100000:2.0:1788463254.765909:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395484928 00000100:00100000:2.0:1788463254.766242:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:2.0:1788463254.766256:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:9686:x1875339395484928:12345-192.168.204.11@tcp:101:rm.0 00010000:00010000:2.0:1788463254.766279:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463254.766301:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd89 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463254.766411:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788463254.766568:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd89 expref: 14 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.766582:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519ac00) 00010000:00010000:2.0:1788463254.766585:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463254.766590:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd89 expref: 14 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.766603:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cae00, rc 0) 00000100:00100000:2.0:1788463254.766803:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:9686:x1875339395484928:12345-192.168.204.11@tcp:101:rm.0 Request processed in 551us (1051us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788463254.766811:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:0.0:1788463254.771377:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463254.771634:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395485056 00000100:00100000:2.0:1788463254.771648:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395485056 00000100:00100000:2.0:1788463254.771955:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:2.0:1788463254.771968:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:9686:x1875339395485056:12345-192.168.204.11@tcp:37:rm.0 00000100:00100000:2.0:1788463254.777652:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:9686:x1875339395485056:12345-192.168.204.11@tcp:37:rm.0 Request processed in 5674us (6273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463254.777668:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:0.0:1788463254.781142:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463254.781230:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395485312 00000100:00100000:1.0:1788463254.781240:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395485312 00000100:00100000:1.0:1788463254.781312:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:1.0:1788463254.781324:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:9686:x1875339395485312:12345-192.168.204.11@tcp:35:rm.0 00000100:00100000:1.0:1788463254.781672:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05e8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:9686:x1875339395485312:12345-192.168.204.11@tcp:35:rm.0 Request processed in 350us (539us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788463254.781680:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:0.0:1788463254.785080:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463254.785209:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395485568 00000100:00100000:3.0:1788463254.785219:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395485568 00000100:00100000:3.0:1788463254.785283:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:3.0:1788463254.785294:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:9686:x1875339395485568:12345-192.168.204.11@tcp:101:rm.0 00010000:00010000:3.0:1788463254.785318:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463254.785339:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd90 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.785437:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.785475:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.785488:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463254.785502:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788463254.785630:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd90 expref: 17 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.785649:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd90 expref: 16 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463254.785657:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5d0c1e600) 00010000:00010000:3.0:1788463254.785660:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788463254.785663:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0600, rc 0) 00000100:00100000:3.0:1788463254.785773:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:9686:x1875339395485568:12345-192.168.204.11@tcp:101:rm.0 Request processed in 481us (703us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788463254.785781:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:3.0:1788463254.792627:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463254.792739:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395485696 00000100:00100000:1.0:1788463254.792749:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395485696 00000100:00100000:1.0:1788463254.792823:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:1.0:1788463254.792834:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:9686:x1875339395485696:12345-192.168.204.11@tcp:41:rm.0 00000004:00000024:1.0:1788463254.792905:0:5818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788463254.792994:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:9686:x1875339395485696:12345-192.168.204.11@tcp:41:rm.0 Request processed in 162us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463254.793001:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:1.0:1788463254.796131:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463254.796254:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395485824 00000100:00100000:0.0:1788463254.796269:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395485824 00000100:00100000:0.0:1788463254.796350:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:0.0:1788463254.796365:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:9686:x1875339395485824:12345-192.168.204.11@tcp:101:rm.0 00010000:00010000:0.0:1788463254.796395:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463254.796420:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35b5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd97 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796506:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796538:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796551:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796568:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796575:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796581:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796772:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35b72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796781:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796787:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463254.796830:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788463254.796835:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463254.796859:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796871:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796889:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796897:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796904:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796909:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463254.796914:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796921:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796935:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5d0c1e600) 00010000:00010000:0.0:1788463254.796938:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463254.796944:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796950:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796964:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796970:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796976:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796987:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463254.796990:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.796996:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.797005:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff9ba5c519af00) 00010000:00010000:0.0:1788463254.797007:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463254.797010:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.797016:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.797052:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35b5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd97 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.797065:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd97 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.797072:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:0.0:1788463254.797074:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463254.797077:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f400, rc 0) 00000100:00100000:0.0:1788463254.797342:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:9686:x1875339395485824:12345-192.168.204.11@tcp:101:rm.0 Request processed in 977us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463254.797351:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:0.0:1788463254.807335:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463254.811260:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395486080 00000100:00100000:2.0:1788463254.811276:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395486080 00000100:00100000:2.0:1788463254.811358:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:2.0:1788463254.811371:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:9686:x1875339395486080:12345-192.168.204.11@tcp:36:rm.0 00010000:00010000:2.0:1788463254.811439:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788463254.811486:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35b72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd97 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.811514:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35b1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd7b expref: 16 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.811528:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:2.0:1788463254.811558:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35b33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd82 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.811570:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5d0c1e600) 00010000:00010000:2.0:1788463254.811589:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463254.811613:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35b79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.811627:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35b79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.811638:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35b79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.811652:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.811660:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.811667:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.812059:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b87 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.812069:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.812080:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463254.813666:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788463254.815031:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286425343864ns, next at 287423995413ns, rc = 0 00010000:00010000:2.0:1788463254.815991:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816034:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816048:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816058:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816065:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816071:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816106:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463254.816275:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816282:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b87 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816289:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816295:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cae00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463254.816299:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816306:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b87 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816329:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ba5d0c1e200) 00010000:00010000:2.0:1788463254.816331:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788463254.816336:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b87 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816341:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35b87 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816363:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35b79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816370:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35b79 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816375:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35b79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816379:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cac00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463254.816381:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35b79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816387:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35b79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816395:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5d0c1e600) 00010000:00010000:2.0:1788463254.816397:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463254.816400:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35b79 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463254.816405:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35b79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463254.816424:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000767a7e0b reply state 000000006bb1e32d transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463254.816433:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463254.816616:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:9686:x1875339395486080:12345-192.168.204.11@tcp:36:rm.0 Request processed in 5242us (9289us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788463254.816627:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 30 00010000:00010000:0.0:1788463254.817968:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463254.817983:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.817993:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cb800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463254.817998:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.818011:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.818031:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ba5d0c1e200) 00010000:00010000:0.0:1788463254.818034:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788463254.818038:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.818045:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb800/0xc3fe72277ee35b8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.818075:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463254.818077:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463254.818078:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463254.821719:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.821746:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.821755:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.821761:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8ca400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463254.821768:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.821779:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.821810:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff9ba5d0c1eb00) 00010000:00010000:1.0:1788463254.821814:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463254.821819:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.821849:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca400/0xc3fe72277ee35b80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463254.823027:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463254.823558:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395486336 00000100:00100000:1.0:1788463254.823568:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395486336 00000100:00100000:1.0:1788463254.823623:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:1.0:1788463254.823634:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:9686:x1875339395486336:12345-192.168.204.11@tcp:35:rm.0 00000100:00100000:1.0:1788463254.823933:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:9686:x1875339395486336:12345-192.168.204.11@tcp:35:rm.0 Request processed in 300us (913us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788463254.824373:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:2.0:1788463254.832219:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463254.832408:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395486592 00000100:00100000:0.0:1788463254.832426:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395486592 00000100:00100000:0.0:1788463254.832522:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:0.0:1788463254.832534:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:9686:x1875339395486592:12345-192.168.204.11@tcp:36:rm.0 00010000:00010000:0.0:1788463254.832621:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788463254.832656:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35b4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd90 expref: 16 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.834065:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35aed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd6d expref: 15 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.834081:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5d0c1e600) 00010000:00010000:0.0:1788463254.834101:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c0031a00/0xc3fe72277ee35aae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd5f expref: 14 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.834109:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519ac00) 00010000:00010000:0.0:1788463254.834115:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463254.834224:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b95 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.834239:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.834250:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.834264:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.834270:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.834275:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.834920:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ba3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.835113:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.835123:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463254.836429:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788463254.836463:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836472:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ba3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836479:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ba3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836485:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463254.836490:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ba3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836498:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ba3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836513:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ba5c519a600) 00010000:00010000:0.0:1788463254.836516:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788463254.836520:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ba3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836527:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ba3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836553:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836567:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b95 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836572:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b95 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836578:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463254.836581:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b95 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836587:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b95 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836869:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519af00) 00010000:00010000:0.0:1788463254.836872:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463254.836876:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b95 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463254.836881:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35b95 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463254.836897:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000673addc6 reply state 00000000f5aeadca transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463254.836907:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788463254.837103:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:9686:x1875339395486592:12345-192.168.204.11@tcp:36:rm.0 Request processed in 4566us (4896us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788463254.837113:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 31 00010000:00010000:1.0:1788463254.845472:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.845495:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.845504:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.845511:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463254.845517:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.845525:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.845543:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ba5c519a500) 00010000:00010000:1.0:1788463254.845546:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463254.845569:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463254.845576:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35b9c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463255.247072:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463255.247127:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463255.247354:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395486720 00000100:00100000:0.0:1788463255.247365:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395486720 00000100:00100000:0.0:1788463255.247453:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 252 00000100:00100000:0.0:1788463255.247464:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2357:x1875339395486720:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463255.247549:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2357:x1875339395486720:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 86us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463255.247558:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 252 00000100:00100000:1.0:1788463255.249371:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395486848 00000100:00100000:1.0:1788463255.249388:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395486848 00000100:00100000:1.0:1788463255.249486:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 106 00000100:00100000:1.0:1788463255.249498:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2357:x1875339395486848:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463255.249593:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2357:x1875339395486848:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 97us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463255.249601:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 106 00000100:00080000:0.0:1788463255.253930:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788463255.400385:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463256.421793:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463257.447017:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788463258.148952:0:6686:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 289759263989ns, next at 290759261135ns, rc = 0 00000100:00100000:1.0:1788463258.149050:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463258.149072:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408104192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463258.149150:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463258.149568:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408104192 00000100:00100000:0.0:1788463258.149577:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408104192 00000100:00100000:0.0:1788463258.149657:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788463258.149668:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408104192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463258.149727:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463258.149793:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408104192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463258.149801:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788463258.149893:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fe9cbb80 x1875339408104192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463258.149915:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408104192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463258.149973:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463258.471782:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463259.174527:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408104704:0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.174600:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463259.174657:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788463259.174663:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408104320:0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.174719:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463259.174743:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408104832:0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.174765:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463259.174789:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408104576:0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.174818:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463259.174837:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788463259.174842:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408104448:0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.174880:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463259.174899:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408104960:0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.174918:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463259.174960:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408104704 00000100:00100000:2.0:1788463259.174968:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408104704 00000100:00100000:2.0:1788463259.175022:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408104832 00000100:00100000:2.0:1788463259.175025:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408104832 00000100:00100000:2.0:1788463259.175042:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408104448 00000100:00100000:2.0:1788463259.175045:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408104448 00000100:00100000:2.0:1788463259.175060:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788463259.175067:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408104704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.175120:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408104704:12345-0@lo:400:kworker.0 Request processed in 53us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463259.175127:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788463259.175142:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788463259.175148:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408104832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.175175:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408104832:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463259.175180:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788463259.175191:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788463259.175197:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408104448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.175227:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408104448:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463259.175233:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788463259.175249:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408104320 00000100:00100000:2.0:1788463259.175252:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408104320 00000100:00100000:2.0:1788463259.175278:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788463259.175292:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408104320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.175319:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408104320:12345-0@lo:400:kworker.0 Request processed in 30us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463259.175325:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788463259.175354:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408104576 00000100:00100000:2.0:1788463259.175357:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408104576 00000100:00100000:2.0:1788463259.175394:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408104960 00000100:00100000:2.0:1788463259.175397:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408104960 00000100:00100000:2.0:1788463259.175416:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788463259.175421:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408104576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.175450:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408104576:12345-0@lo:400:kworker.0 Request processed in 29us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463259.175456:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788463259.175467:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788463259.175472:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408104960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.175495:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408104960:12345-0@lo:400:kworker.0 Request processed in 23us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463259.175500:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788463259.175520:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463259.175525:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463259.175572:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408104448:0@lo:400:kworker.0 00010000:00080000:2.0:1788463259.175584:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4bebb80 x1875339408104960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463259.175594:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4bebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408104960:0@lo:400:kworker.0 00010000:00080000:2.0:1788463259.175602:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5f4be9880 x1875339408104576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463259.175620:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408104576:0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.175659:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408104320:0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.175668:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4beb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408104832:0@lo:400:kworker.0 00000100:00100000:2.0:1788463259.175676:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408104704:0@lo:400:kworker.0 00000001:02000400:1.0:1788463259.233844:0:11613:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788463259.495772:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463259.687740:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408105088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463259.687865:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463259.687970:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408105088 00000100:00100000:0.0:1788463259.687981:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408105088 00000100:00100000:0.0:1788463259.688044:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788463259.688056:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408105088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463259.688104:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463259.688157:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408105088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463259.688165:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788463259.688224:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fe9ca300 x1875339408105088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463259.688246:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408105088:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788463259.759407:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788463259.759451:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788463259.759481:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788463259.760283:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463259.760312:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408105216:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788463259.760451:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463259.760734:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408105216 00000100:00100000:3.0:1788463259.760744:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408105216 00000100:00100000:3.0:1788463259.760808:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788463259.760818:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408105216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788463259.760856:0:6667:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788463259.760913:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a99c897, atime: 0x6a99c897, ctime: 0x6a99c897, blocks: 0x1 00010000:00010000:3.0:1788463259.760923:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35baa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463259.760952:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=291s v=(0 0) 00010000:00010000:3.0:1788463259.760958:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463259.760966:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463259.760986:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463259.760998:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463259.761008:0:6667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463259.761030:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463259.761280:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463259.761288:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463259.761297:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463259.761302:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463259.761326:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35baa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463259.761361:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35baa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463259.761370:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35baa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463259.761395:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463259.761397:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463259.761399:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463259.761796:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1875339408105216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 976us (1342us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788463259.761804:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:1.0:1788463259.761963:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5fea88e00/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788463259.761969:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408105216:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788463260.278776:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:1.0:1788463260.340539:0:11664:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd1ee3240 20000000:00000080:1.0:1788463260.340561:0:11664:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ba5e8483c00 uarg=0000000000000000 20000000:01000000:1.0:1788463260.340599:0:11664:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788463260.340606:0:11664:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788463260.340611:0:11664:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788463260.341599:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788463260.342021:0:11664:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788463260.348197:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788463260.348266:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788463260.348324:0:11664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788463260.348413:0:11664:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788463260.348433:0:11664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348465:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee35a53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35a4c expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348473:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35a5a expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348478:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba4c56b0200/0xc3fe72277ee35a6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35a68 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348487:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee35a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd4a expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348494:0:11664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee35a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd51 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348502:0:11664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348547:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee35a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd51 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348562:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee35a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd51 expref: 12 pid: 5809 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463260.348577:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875339408105344:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463260.348747:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee35a76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd4a expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348756:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee35a76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd4a expref: 12 pid: 5811 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463260.348773:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5614700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875339408105472:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463260.348804:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba4c56b0200/0xc3fe72277ee35a6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35a68 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348812:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba4c56b0200/0xc3fe72277ee35a6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35a68 expref: 18 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463260.348820:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875339408105600:0@lo:104: 00000100:00100000:1.0:1788463260.348855:0:11664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463260.348895:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35a5a expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.348902:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35a5a expref: 18 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463260.348910:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5617800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875339408105728:0@lo:104: 00000100:00100000:1.0:1788463260.349074:0:11664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788463260.349107:0:11664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee35a53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee35a4c expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.349116:0:11664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee35a53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee35a4c expref: 18 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463260.349125:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875339408105856:0@lo:104: 00000100:00100000:1.0:1788463260.349145:0:11664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec066240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463260.349240:0:6681:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788463260.349261:0:6681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463260.349291:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408105600 00000100:00100000:0.0:1788463260.349300:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408105600 00000100:00100000:0.0:1788463260.349362:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408105728 00000100:00100000:0.0:1788463260.349366:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408105728 00000100:00100000:0.0:1788463260.349378:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408105856 00000100:00100000:0.0:1788463260.349381:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408105856 00000100:00100000:0.0:1788463260.349393:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463260.349403:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+5:11664:x1875339408105600:12345-0@lo:104: 00010000:00010000:0.0:1788463260.349418:0:6681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349473:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463260.349480:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+5:11664:x1875339408105600:12345-0@lo:104: Request processed in 79us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463260.349487:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463260.349508:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463260.349514:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+4:11664:x1875339408105728:12345-0@lo:104: 00010000:00010000:0.0:1788463260.349522:0:6681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349551:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788463260.349563:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+4:11664:x1875339408105728:12345-0@lo:104: Request processed in 49us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463260.349568:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463260.349606:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463260.349612:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+3:11664:x1875339408105856:12345-0@lo:104: 00010000:00010000:0.0:1788463260.349619:0:6681:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349651:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788463260.349656:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+3:11664:x1875339408105856:12345-0@lo:104: Request processed in 45us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463260.349661:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788463260.349676:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788463260.349712:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349719:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1788463260.349723:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349731:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463260.349738:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463260.349744:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463260.349770:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349787:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463260.349809:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349816:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488a00/0xc3fe72277ee35a68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a6f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349828:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463260.349831:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349837:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cbe00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1788463260.349840:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349847:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463260.349853:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463260.349858:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463260.349871:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349876:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463260.349890:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349897:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cbe00/0xc3fe72277ee35a5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a61 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349913:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463260.349915:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349932:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488000 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1788463260.349936:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349943:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463260.349950:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463260.349955:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463260.349985:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.349992:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463260.349999:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.350005:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488000/0xc3fe72277ee35a4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee35a53 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.350020:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463260.350022:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463260.350023:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463260.350030:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463260.350058:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408105984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463260.350092:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463260.350130:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408106112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463260.350153:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463260.350172:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463260.350177:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408106240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463260.350198:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463260.350225:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408105984 00000100:00100000:0.0:1788463260.350229:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408105984 00010000:00010000:0.0:1788463260.350249:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba4c56b0200/0xc3fe72277ee35a6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35a68 expref: 19 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463260.350269:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408106112 00000100:00100000:0.0:1788463260.350272:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408106112 00010000:00010000:0.0:1788463260.350282:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35a5a expref: 20 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463260.350291:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408106240 00000100:00100000:0.0:1788463260.350293:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408106240 00010000:00010000:0.0:1788463260.350302:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee35a53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35a4c expref: 21 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463260.350312:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463260.350318:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:777dc377-0af3-4f9e-a02c-a691119a7ded+21:3277:x1875339408105984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463260.350327:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463260.350332:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba4c56b0200/0xc3fe72277ee35a6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35a68 expref: 21 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.350354:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba4c56b0200/0xc3fe72277ee35a6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35a68 expref: 21 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.350380:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463260.350410:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:777dc377-0af3-4f9e-a02c-a691119a7ded+21:3277:x1875339408105984:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463260.350417:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788463260.350432:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463260.350437:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:777dc377-0af3-4f9e-a02c-a691119a7ded+20:3278:x1875339408106112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463260.350445:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463260.350448:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a61 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35a5a expref: 20 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.350456:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35a5a expref: 20 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.350465:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463260.350489:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:777dc377-0af3-4f9e-a02c-a691119a7ded+20:3278:x1875339408106112:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463260.350495:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463260.350507:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463260.350513:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c8992450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408106240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463260.350520:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463260.350524:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee35a53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee35a4c expref: 19 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.350532:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee35a53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee35a4c expref: 19 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463260.350543:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463260.350570:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c8992450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408106240:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463260.350576:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463260.350637:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408105984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463260.350662:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408106240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463260.350671:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408106112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463260.351056:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b0200/0xc3fe72277ee35a6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35a68 expref: 18 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463260.351080:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875339408105600:0@lo:104: 00010000:00010000:1.0:1788463260.351092:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b0800/0xc3fe72277ee35a61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35a5a expref: 17 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463260.351100:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5617800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875339408105728:0@lo:104: 00010000:00010000:1.0:1788463260.351108:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cb600/0xc3fe72277ee35a53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee35a4c expref: 16 pid: 5811 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463260.351115:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875339408105856:0@lo:104: 00010000:00010000:3.0:1788463260.351499:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463260.357675:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463260.357729:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463260.357799:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395486976 00000100:00100000:2.0:1788463260.357807:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395486976 00010000:00010000:2.0:1788463260.357845:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee35a7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd51 expref: 13 pid: 5809 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463260.357878:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395487104 00000100:00100000:2.0:1788463260.357881:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395487104 00010000:00010000:2.0:1788463260.357890:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee35a76 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd4a expref: 14 pid: 5811 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463260.357908:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:2.0:1788463260.357916:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+14:2357:x1875339395486976:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463260.357944:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463260.357950:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee35a7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd51 expref: 14 pid: 5809 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.357963:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee35a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd51 expref: 14 pid: 5809 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.357987:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463260.358040:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+14:2357:x1875339395486976:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 124us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463260.358061:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:2.0:1788463260.358078:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:2.0:1788463260.358084:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2357:x1875339395487104:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463260.358092:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463260.358096:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee35a76 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd4a expref: 13 pid: 5811 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358105:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee35a76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd4a expref: 13 pid: 5811 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358116:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358125:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358140:0:8442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358147:0:8442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358154:0:8442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358161:0:8442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358167:0:8442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463260.358178:0:8442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358186:0:8442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358195:0:8442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463260.358206:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463260.358225:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2357:x1875339395487104:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 141us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463260.358231:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 34 00010000:00010000:1.0:1788463260.359602:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee35a7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd51 expref: 12 pid: 5809 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463260.359623:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875339408105344:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463260.359636:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee35a76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd4a expref: 11 pid: 5811 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463260.359644:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5614700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11664:1875339408105472:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463260.359675:0:11664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.359867:0:11664:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.359876:0:11664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463260.359882:0:11664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c1488800/0xc3fe72277ee35bb1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463260.360918:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463260.361088:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395487360 00000100:00100000:3.0:1788463260.361097:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395487360 00000100:00100000:3.0:1788463260.361174:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:3.0:1788463260.361184:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395487360:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463260.361274:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395487360:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 92us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463260.361282:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00080000:2.0:1788463260.361799:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463260.377449:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463260.377496:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463260.383085:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395487232 00000100:00100000:1.0:1788463260.383100:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395487232 00000100:00100000:1.0:1788463260.383178:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395487488 00000100:00100000:1.0:1788463260.383181:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395487488 00000100:00100000:1.0:1788463260.383211:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 110 00000100:00100000:1.0:1788463260.383225:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395487232:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463260.383315:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395487232:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 93us (5875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463260.383323:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 110 00000100:00100000:1.0:1788463260.383358:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 111 00000100:00100000:1.0:1788463260.383365:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2357:x1875339395487488:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463260.383391:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2357:x1875339395487488:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 27us (5895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463260.383398:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 111 00000100:00080000:0.0:1788463260.383947:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463260.520450:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788463261.541018:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788463261.541027:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba4c5230000 from 7 10000000:01000000:0.0:1788463261.541032:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788463261.541092:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463261.541107:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463261.541118:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463261.541149:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408106368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788463261.541230:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463261.541292:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ce300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463261.541366:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408106368 00000100:00100000:3.0:1788463261.541376:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408106368 00000100:00100000:3.0:1788463261.541432:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788463261.541442:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+16:5813:x1875339408106368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463261.541456:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463261.541472:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b0400/0xc3fe72277ee35bbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35bb8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463261.541496:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b0400/0xc3fe72277ee35bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35bb8 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463261.541507:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b0400/0xc3fe72277ee35bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35bb8 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463261.541517:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0400, rc 0) 00000100:00100000:3.0:1788463261.541568:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408106368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463261.541574:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788463261.541780:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408106368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463261.541815:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463261.541823:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463261.541882:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408106496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463261.541912:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463261.541940:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ce300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463261.541993:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408106496 00000100:00100000:2.0:1788463261.541998:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408106496 00000100:00100000:2.0:1788463261.542033:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788463261.542042:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408106496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463261.542336:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408106496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463261.542343:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788463261.545097:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408106496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463261.545172:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408106624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463261.545265:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463261.545323:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ce300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463261.547613:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408106624 00000100:00100000:2.0:1788463261.547630:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408106624 00000100:00100000:2.0:1788463261.547738:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788463261.547749:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408106624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463261.548018:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408106624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (2752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463261.548035:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00010000:00010000:0.0:1788463261.548339:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463261.548380:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408106624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463261.548976:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11677:1875339408106752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463261.549038:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463261.549079:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ce9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463261.549136:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408106752 00000100:00100000:3.0:1788463261.549144:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408106752 00000100:00100000:3.0:1788463261.549206:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788463261.549218:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:11677:x1875339408106752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463261.549440:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+17:11677:x1875339408106752:12345-0@lo:502:llog_process_th.0 Request processed in 225us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463261.549458:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788463261.549598:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11677:1875339408106752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788463261.549624:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463261.549634:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463261.549637:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788463261.549644:0:11677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ba4c5230000 00000020:00000080:0.0:1788463261.549647:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788463261.549754:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11677:1875339408106880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463261.549797:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463261.549824:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463261.552838:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408106880 00000100:00100000:2.0:1788463261.552852:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408106880 00000100:00100000:2.0:1788463261.552910:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788463261.552919:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:11677:x1875339408106880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463261.553181:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:11677:x1875339408106880:12345-0@lo:502:llog_process_th.0 Request processed in 262us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463261.553202:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788463261.554065:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11677:1875339408106880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788463261.554111:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463261.554121:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463261.554124:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788463261.554132:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788463261.554714:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788463261.554743:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463261.554758:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463261.554771:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463261.554784:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463261.554787:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c2e32800 from 7 10000000:01000000:2.0:1788463261.554791:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463261.554838:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463261.554847:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463261.554858:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463261.554884:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463261.554972:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463261.555026:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f499c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463261.555101:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408107008 00000100:00100000:3.0:1788463261.555108:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408107008 00000100:00100000:3.0:1788463261.555157:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788463261.555166:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+17:5813:x1875339408107008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463261.555180:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463261.555209:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b1c00/0xc3fe72277ee35bcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35bc6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463261.555235:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b1c00/0xc3fe72277ee35bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35bc6 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463261.555246:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b1c00/0xc3fe72277ee35bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35bc6 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463261.555255:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1c00, rc 0) 00000100:00100000:3.0:1788463261.555296:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408107008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463261.555302:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788463261.555565:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea89180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463261.555580:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463261.555589:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463261.555643:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463261.555670:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463261.555698:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463261.555753:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408107136 00000100:00100000:2.0:1788463261.555758:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408107136 00000100:00100000:2.0:1788463261.555789:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788463261.555798:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408107136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463261.556075:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408107136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463261.556082:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788463261.556156:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463261.556182:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463261.556356:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463261.556380:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463261.556431:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408107264 00000100:00100000:2.0:1788463261.556435:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408107264 00000100:00100000:2.0:1788463261.556464:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788463261.556471:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408107264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463261.556603:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408107264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463261.556610:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788463261.556642:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463261.556841:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11679:1875339408107392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463261.556870:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463261.556886:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408107392 00000100:00100000:2.0:1788463261.556889:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408107392 00000100:00100000:2.0:1788463261.556904:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788463261.556909:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:11679:x1875339408107392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463261.557012:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:11679:x1875339408107392:12345-0@lo:502:llog_process_th.0 Request processed in 102us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463261.557026:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788463261.557048:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8b7f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463261.557058:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11679:1875339408107392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463261.557076:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463261.557084:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463261.557086:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788463261.557091:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ba5c2e32800 00000020:00000080:2.0:1788463261.557094:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788463261.558479:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11679:1875339408107520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463261.558538:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463261.558568:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed180 going to sleep for 11 seconds 00000100:00100000:3.0:1788463261.558589:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408107520 00000100:00100000:3.0:1788463261.558594:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408107520 00000100:00100000:3.0:1788463261.558623:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788463261.558630:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:11679:x1875339408107520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463261.558826:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:11679:x1875339408107520:12345-0@lo:502:llog_process_th.0 Request processed in 196us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463261.558839:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788463261.558889:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11679:1875339408107520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788463261.558912:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463261.558919:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463261.558921:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788463261.558925:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788463261.559052:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788463261.559072:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463261.559082:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463261.559093:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463261.559103:0:5813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788463261.559106:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c88d5800 from 7 10000000:01000000:3.0:1788463261.559109:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788463261.559134:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463261.559142:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463261.559151:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463261.559166:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463261.560496:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463261.560533:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c4aed180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463261.560710:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408107648 00000100:00100000:0.0:1788463261.560719:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408107648 00000100:00100000:0.0:1788463261.560765:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788463261.560774:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:5813:x1875339408107648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463261.560789:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463261.560810:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5e710f200/0xc3fe72277ee35bdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee35bd4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463261.560836:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5e710f200/0xc3fe72277ee35bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee35bd4 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463261.560846:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5e710f200/0xc3fe72277ee35bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee35bd4 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463261.560854:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f200, rc 0) 00000100:00100000:0.0:1788463261.560894:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408107648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463261.560900:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788463261.561704:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463261.561727:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463261.561738:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463261.561815:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463261.561855:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463261.561882:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4ba2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463261.562097:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408107776 00000100:00100000:0.0:1788463261.562103:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408107776 00000100:00100000:0.0:1788463261.562142:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788463261.562151:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408107776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463261.562593:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408107776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 441us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463261.562601:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788463261.562775:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463261.562809:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463261.562852:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463261.562911:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4ba2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463261.565399:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408107904 00000100:00100000:3.0:1788463261.565417:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408107904 00000100:00100000:3.0:1788463261.565487:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788463261.565497:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408107904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463261.565769:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:5813:x1875339408107904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 272us (2915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463261.565777:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788463261.565904:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:777dc377-0af3-4f9e-a02c-a691119a7ded:5813:1875339408107904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463261.568417:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11680:1875339408108032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463261.568502:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463261.568560:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8b7fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463261.569130:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408108032 00000100:00100000:1.0:1788463261.569140:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408108032 00000100:00100000:1.0:1788463261.569198:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788463261.569209:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:11680:x1875339408108032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463261.569556:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:11680:x1875339408108032:12345-0@lo:502:llog_process_th.0 Request processed in 348us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463261.569563:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788463261.569658:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11680:1875339408108032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463261.569719:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463261.569729:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463261.569732:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788463261.569738:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ba5c88d5800 00000020:00000080:2.0:1788463261.569740:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788463261.569827:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11680:1875339408108160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463261.569871:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463261.569898:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4ba2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463261.569997:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408108160 00000100:00100000:3.0:1788463261.570003:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408108160 00000100:00100000:3.0:1788463261.570041:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788463261.570049:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:11680:x1875339408108160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788463261.570179:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:11680:x1875339408108160:12345-0@lo:502:llog_process_th.0 Request processed in 130us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463261.570203:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788463261.570508:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea88a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:777dc377-0af3-4f9e-a02c-a691119a7ded:11680:1875339408108160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463261.570531:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463261.570538:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463261.570539:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788463261.570543:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788463261.570762:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788463261.570780:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788463261.570790:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463261.570801:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463261.592615:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788463262.216041:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463262.218085:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395487616 00000100:00100000:1.0:1788463262.218100:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395487616 00000100:00100000:1.0:1788463262.218173:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 269 00000100:00100000:1.0:1788463262.218199:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:5596:x1875339395487616:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463262.218217:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463262.218236:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35be2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dd9e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463262.218268:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd9e expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463262.218280:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd9e expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463262.218290:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489800, rc 0) 00000100:00100000:1.0:1788463262.218378:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395487616:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 181us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463262.218385:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 269 00000100:00100000:1.0:1788463262.232534:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463262.232750:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395487744 00000100:00100000:2.0:1788463262.232762:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395487744 00000100:00100000:2.0:1788463262.232825:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 270 00000100:00100000:2.0:1788463262.232836:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395487744:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463262.234415:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395487744:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 1570us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463262.234429:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 270 00000100:00100000:0.0:1788463262.239975:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463262.240122:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395487872 00000100:00100000:3.0:1788463262.240132:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395487872 00000100:00100000:3.0:1788463262.240194:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 271 00000100:00100000:3.0:1788463262.240208:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395487872:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463262.240506:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395487872:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 300us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463262.240515:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 271 00000100:00100000:3.0:1788463262.255422:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463262.255569:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395488000 00000100:00100000:2.0:1788463262.255583:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395488000 00000100:00100000:2.0:1788463262.255664:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 272 00000100:00100000:2.0:1788463262.255675:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:9956:x1875339395488000:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463262.256266:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:9956:x1875339395488000:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 590us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463262.256275:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 272 00000100:00100000:2.0:1788463262.262264:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463262.262475:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395488128 00000100:00100000:1.0:1788463262.262485:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395488128 00000100:00100000:1.0:1788463262.262592:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 273 00000100:00100000:1.0:1788463262.262603:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:9956:x1875339395488128:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463262.262930:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:9956:x1875339395488128:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 327us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463262.262939:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 273 00000100:00100000:3.0:1788463262.272876:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463262.274764:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395488256 00000100:00100000:2.0:1788463262.274780:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395488256 00000100:00100000:2.0:1788463262.275514:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 274 00000100:00100000:2.0:1788463262.275529:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:5596:x1875339395488256:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463262.275548:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463262.275569:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35be9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dda5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463262.275601:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dda5 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463262.275613:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dda5 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463262.275622:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8ca400, rc 0) 00000100:00100000:2.0:1788463262.275739:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:5596:x1875339395488256:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 213us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463262.275746:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 274 00000100:00100000:2.0:1788463262.282946:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463262.283080:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395488384 00000100:00100000:1.0:1788463262.283092:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395488384 00000100:00100000:1.0:1788463262.283153:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 275 00000100:00100000:1.0:1788463262.283163:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:5596:x1875339395488384:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463262.283888:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:5596:x1875339395488384:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 721us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463262.283897:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 275 00000100:00100000:1.0:1788463262.285770:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463262.286147:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395488512 00000100:00100000:2.0:1788463262.286157:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395488512 00000100:00100000:2.0:1788463262.286285:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 276 00000100:00100000:2.0:1788463262.286297:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:5596:x1875339395488512:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463262.286553:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:5596:x1875339395488512:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 257us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463262.286562:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 276 00000100:00100000:3.0:1788463262.289752:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463262.289871:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395488640 00000100:00100000:1.0:1788463262.289880:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395488640 00000100:00100000:1.0:1788463262.289939:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 277 00000100:00100000:1.0:1788463262.289950:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:9959:x1875339395488640:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463262.290284:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:9959:x1875339395488640:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 335us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463262.290292:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 277 00000100:00100000:1.0:1788463262.294970:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463262.295087:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395488768 00000100:00100000:0.0:1788463262.295100:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395488768 00000100:00100000:0.0:1788463262.295156:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 278 00000100:00100000:0.0:1788463262.295166:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:9959:x1875339395488768:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463262.295480:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:9959:x1875339395488768:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 315us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463262.295499:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 278 00010000:00010000:0.0:1788463262.568662:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788463262.632489:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788463263.271419:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408108288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463263.271504:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463263.271714:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408108288 00000100:00100000:0.0:1788463263.271722:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408108288 00000100:00100000:0.0:1788463263.271790:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788463263.271800:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408108288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463263.271834:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463263.271886:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408108288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463263.271894:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788463263.271933:0:3276:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788463263.271939:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5fea88e00, transno 4294967300 00000100:00100000:0.0:1788463263.271956:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408108288:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788463263.272506:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788463263.589865:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463264.294394:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408108672:0@lo:400:kworker.0 00000100:00100000:0.0:1788463264.294470:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463264.294540:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788463264.294547:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408108544:0@lo:400:kworker.0 00000100:00100000:0.0:1788463264.294575:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463264.294596:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408109056:0@lo:400:kworker.0 00000100:00100000:0.0:1788463264.294618:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463264.294647:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408108672 00000100:00100000:0.0:1788463264.294655:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408108672 00000100:00100000:0.0:1788463264.294727:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408109056 00000100:00100000:0.0:1788463264.294731:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408109056 00000100:00100000:0.0:1788463264.294766:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463264.294774:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408108672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463264.294844:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408108672:12345-0@lo:400:kworker.0 Request processed in 69us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463264.294851:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463264.294868:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463264.294873:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408109056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463264.294898:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408109056:12345-0@lo:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463264.294903:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463264.294920:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408108544 00000100:00100000:0.0:1788463264.294924:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408108544 00000100:00100000:0.0:1788463264.294947:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788463264.294953:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408108544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463264.294982:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408108544:12345-0@lo:400:kworker.0 Request processed in 29us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463264.294987:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788463264.295010:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463264.295038:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408108544:0@lo:400:kworker.0 00010000:00080000:0.0:1788463264.295052:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec435500 x1875339408109056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463264.295062:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408109056:0@lo:400:kworker.0 00000100:00100000:0.0:1788463264.295072:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408108672:0@lo:400:kworker.0 00000100:00100000:2.0:1788463264.295300:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408108800:0@lo:400:kworker.0 00000100:00100000:2.0:1788463264.295335:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463264.295372:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788463264.295378:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408108416:0@lo:400:kworker.0 00000100:00100000:2.0:1788463264.295404:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463264.295434:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408108928:0@lo:400:kworker.0 00000100:00100000:2.0:1788463264.295458:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463264.295564:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408108416 00000100:00100000:3.0:1788463264.295570:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408108416 00000100:00100000:3.0:1788463264.295610:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788463264.295618:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408108416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463264.295659:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408108416:12345-0@lo:400:kworker.0 Request processed in 43us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463264.295666:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788463264.295730:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408108416:0@lo:400:kworker.0 00000100:00100000:1.0:1788463264.295807:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408108800 00000100:00100000:1.0:1788463264.295811:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408108800 00000100:00100000:1.0:1788463264.295855:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408108928 00000100:00100000:1.0:1788463264.295858:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408108928 00000100:00100000:1.0:1788463264.295877:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788463264.295884:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408108800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463264.295921:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408108800:12345-0@lo:400:kworker.0 Request processed in 37us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463264.295926:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788463264.295936:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788463264.295941:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408108928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463264.295965:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408108928:12345-0@lo:400:kworker.0 Request processed in 24us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463264.295970:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788463264.296021:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408108928:0@lo:400:kworker.0 00000100:00100000:1.0:1788463264.296030:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408108800:0@lo:400:kworker.0 00000100:00080000:3.0:1788463264.296087:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463264.612937:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463264.805356:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408109184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463264.805460:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463264.805915:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408109184 00000100:00100000:0.0:1788463264.805924:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408109184 00000100:00100000:0.0:1788463264.805983:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788463264.805993:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408109184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463264.806046:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463264.806106:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408109184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463264.806113:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788463264.806205:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec435c00 x1875339408109184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463264.806222:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408109184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463265.482464:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463265.482504:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463265.482739:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463265.482927:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395488896 00000100:00100000:2.0:1788463265.482938:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395488896 00000100:00100000:2.0:1788463265.482991:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 280 00000100:00100000:2.0:1788463265.483002:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2355:x1875339395488896:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463265.483082:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2355:x1875339395488896:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 82us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463265.483109:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 280 00000100:00100000:0.0:1788463265.484447:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395489024 00000100:00100000:0.0:1788463265.484462:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395489024 00000100:00080000:3.0:1788463265.484723:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463265.484995:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395489280 00000100:00100000:0.0:1788463265.485001:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395489280 00000100:00100000:0.0:1788463265.485089:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 115 00000100:00100000:0.0:1788463265.485100:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2355:x1875339395489024:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463265.485182:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2355:x1875339395489024:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 83us (2727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463265.485189:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 115 00000100:00100000:0.0:1788463265.485206:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 116 00000100:00100000:0.0:1788463265.485212:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2355:x1875339395489280:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463265.485254:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2355:x1875339395489280:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 41us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463265.485261:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 116 00000100:00080000:3.0:1788463265.494049:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463265.498491:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463265.507415:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395489152 00000100:00100000:0.0:1788463265.507438:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395489152 00000100:00080000:3.0:1788463265.507717:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463265.507846:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:0.0:1788463265.507860:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2355:x1875339395489152:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463265.507953:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2355:x1875339395489152:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 97us (9472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463265.507962:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 63 00010000:00010000:0.0:1788463265.639846:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463266.663801:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463267.684944:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463268.389114:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463268.389146:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408109312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463268.389255:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463268.389494:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408109312 00000100:00100000:0.0:1788463268.389504:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408109312 00000100:00100000:0.0:1788463268.389586:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463268.389596:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408109312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463268.389643:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463268.389720:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408109312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463268.389727:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788463268.389813:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408109312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463268.396325:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463268.708872:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463269.414336:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408109696:0@lo:400:kworker.0 00000100:00100000:2.0:1788463269.414449:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463269.414560:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788463269.414567:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408109568:0@lo:400:kworker.0 00000100:00100000:2.0:1788463269.414602:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463269.414623:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408110080:0@lo:400:kworker.0 00000100:00100000:2.0:1788463269.414663:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463269.414730:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408109440:0@lo:400:kworker.0 00000100:00100000:2.0:1788463269.414767:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463269.414792:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408109952:0@lo:400:kworker.0 00000100:00100000:2.0:1788463269.414814:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463269.414831:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463269.414837:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408109824:0@lo:400:kworker.0 00000100:00100000:2.0:1788463269.414857:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463269.414886:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408109440 00000100:00100000:2.0:1788463269.414895:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408109440 00000100:00100000:2.0:1788463269.414948:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788463269.414957:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408109440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463269.415022:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408109440:12345-0@lo:400:kworker.0 Request processed in 65us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463269.415048:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788463269.415115:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408109440:0@lo:400:kworker.0 00000100:00100000:3.0:1788463269.415434:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408109696 00000100:00100000:3.0:1788463269.415441:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408109696 00000100:00100000:3.0:1788463269.415491:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408110080 00000100:00100000:3.0:1788463269.415495:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408110080 00000100:00100000:3.0:1788463269.415540:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788463269.415547:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408109696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463269.415592:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408109696:12345-0@lo:400:kworker.0 Request processed in 46us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463269.415599:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788463269.415613:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788463269.415619:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408110080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463269.415662:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4beb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408110080:12345-0@lo:400:kworker.0 Request processed in 43us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463269.415668:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788463269.415706:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788463269.415732:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5616300 x1875339408110080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463269.415745:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408110080:0@lo:400:kworker.0 00000100:00100000:3.0:1788463269.415757:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408109696:0@lo:400:kworker.0 00000100:00100000:0.0:1788463269.416003:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408109568 00000100:00100000:0.0:1788463269.416007:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408109568 00000100:00100000:0.0:1788463269.416043:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408109952 00000100:00100000:0.0:1788463269.416046:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408109952 00000100:00100000:0.0:1788463269.416067:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408109824 00000100:00100000:0.0:1788463269.416070:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408109824 00000100:00100000:0.0:1788463269.416087:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788463269.416093:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408109568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463269.416134:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408109568:12345-0@lo:400:kworker.0 Request processed in 42us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463269.416140:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788463269.416153:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788463269.416158:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408109952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463269.416209:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408109952:12345-0@lo:400:kworker.0 Request processed in 51us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463269.416215:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788463269.416226:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788463269.416232:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408109824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463269.416268:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408109824:12345-0@lo:400:kworker.0 Request processed in 37us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463269.416274:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788463269.416314:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408109824:0@lo:400:kworker.0 00000100:00100000:0.0:1788463269.416323:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408109952:0@lo:400:kworker.0 00000100:00080000:3.0:1788463269.417735:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463269.417810:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408109568:0@lo:400:kworker.0 00010000:00010000:0.0:1788463269.733052:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463269.924975:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463269.925013:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408110208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463269.925113:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463269.925213:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408110208 00000100:00100000:3.0:1788463269.925223:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408110208 00000100:00100000:3.0:1788463269.925279:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788463269.925289:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408110208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463269.925343:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463269.925393:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408110208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463269.925400:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788463269.925443:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fee03800 x1875339408110208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463269.925461:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408110208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463270.610047:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463270.610088:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463270.610129:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463270.610171:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463270.610210:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395489536 00000100:00100000:0.0:1788463270.610223:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395489536 00000100:00100000:0.0:1788463270.610287:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395489792 00000100:00100000:0.0:1788463270.610290:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395489792 00000100:00100000:0.0:1788463270.610316:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 120 00000100:00100000:0.0:1788463270.610326:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395489536:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463270.610419:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395489536:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 94us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463270.610426:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 120 00000100:00100000:0.0:1788463270.610444:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 121 00000100:00100000:0.0:1788463270.610451:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395489792:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463270.610476:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395489792:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463270.610481:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 121 00000100:00100000:3.0:1788463270.611345:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395489408 00000100:00100000:3.0:1788463270.611355:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395489408 00000100:00100000:3.0:1788463270.611421:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 282 00000100:00100000:3.0:1788463270.611432:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395489408:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463270.611491:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395489408:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 62us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463270.611498:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 282 00000100:00080000:3.0:1788463270.611532:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463270.611825:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395489664 00000100:00100000:1.0:1788463270.611831:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395489664 00000100:00100000:1.0:1788463270.611899:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 66 00000100:00100000:1.0:1788463270.611907:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395489664:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463270.611948:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395489664:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 36us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463270.611954:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 66 00000100:00080000:3.0:1788463270.616030:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788463270.765197:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463271.781143:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463272.805318:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463272.869769:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788463273.509129:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408110336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463273.509226:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463273.509607:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408110336 00000100:00100000:1.0:1788463273.509619:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408110336 00000100:00100000:1.0:1788463273.509740:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788463273.509753:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408110336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463273.509801:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788463273.509938:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463273.510206:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408110336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 455us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463273.510224:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788463273.510499:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408110336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788463273.832028:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463274.538099:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408110592:0@lo:400:kworker.0 00000100:00100000:1.0:1788463274.538216:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463274.538252:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408110592 00000100:00100000:0.0:1788463274.538261:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408110592 00000100:00100000:1.0:1788463274.538280:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408111104:0@lo:400:kworker.0 00000100:00100000:1.0:1788463274.538310:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463274.538334:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788463274.538344:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408110592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463274.538352:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463274.538358:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408110720:0@lo:400:kworker.0 00000100:00100000:1.0:1788463274.538379:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463274.538393:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408110592:12345-0@lo:400:kworker.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.538400:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788463274.538416:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408110592:0@lo:400:kworker.0 00000100:00100000:0.0:1788463274.538442:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408111104 00000100:00100000:0.0:1788463274.538446:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408111104 00000100:00100000:0.0:1788463274.538479:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408110720 00000100:00100000:0.0:1788463274.538482:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408110720 00000100:00100000:0.0:1788463274.538498:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788463274.538505:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408111104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463274.538538:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408111104:12345-0@lo:400:kworker.0 Request processed in 33us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.538544:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788463274.538555:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788463274.538562:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408110720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463274.538588:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408110720:12345-0@lo:400:kworker.0 Request processed in 26us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463274.538594:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788463274.539142:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408110720:0@lo:400:kworker.0 00010000:00080000:1.0:1788463274.539161:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec437800 x1875339408111104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463274.539172:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408111104:0@lo:400:kworker.0 00000100:00100000:3.0:1788463274.539358:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408110848:0@lo:400:kworker.0 00000100:00100000:3.0:1788463274.539417:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463274.539459:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788463274.539466:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408110464:0@lo:400:kworker.0 00000100:00100000:3.0:1788463274.539508:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463274.539543:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408110976:0@lo:400:kworker.0 00000100:00100000:3.0:1788463274.539566:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463274.539753:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408110848 00000100:00100000:3.0:1788463274.539761:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408110848 00000100:00080000:2.0:1788463274.539795:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463274.539802:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408110976 00000100:00080000:2.0:1788463274.539803:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463274.539807:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408110976 00000100:00100000:2.0:1788463274.539825:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788463274.539841:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408110848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463274.539846:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788463274.539856:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408110976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463274.539913:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408110848:12345-0@lo:400:kworker.0 Request processed in 77us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463274.539915:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408110976:12345-0@lo:400:kworker.0 Request processed in 59us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463274.539928:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1788463274.539949:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463274.539975:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408110976:0@lo:400:kworker.0 00000100:00100000:2.0:1788463274.539987:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408110848:0@lo:400:kworker.0 00000100:00100000:1.0:1788463274.540819:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408110464 00000100:00100000:1.0:1788463274.540830:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408110464 00000100:00100000:1.0:1788463274.540900:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788463274.540910:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408110464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463274.541000:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408110464:12345-0@lo:400:kworker.0 Request processed in 92us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463274.541007:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788463274.541355:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408110464:0@lo:400:kworker.0 00000100:00100000:3.0:1788463274.542106:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00010000:2.0:1788463274.852996:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463275.045857:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408111232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463275.045966:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463275.047030:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408111232 00000100:00100000:0.0:1788463275.047048:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408111232 00000100:00100000:0.0:1788463275.047130:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788463275.047144:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408111232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463275.047195:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463275.047305:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408111232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463275.047313:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788463275.050447:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec434380 x1875339408111232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463275.050495:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408111232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463275.737892:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463275.737983:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463275.738162:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395490048 00000100:00100000:1.0:1788463275.738179:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395490048 00000100:00100000:1.0:1788463275.738291:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 125 00000100:00100000:1.0:1788463275.738305:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395490048:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463275.738440:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395490048:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 136us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463275.738450:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 125 00000100:00080000:3.0:1788463275.739528:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463275.741401:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395489920 00000100:00100000:2.0:1788463275.741429:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395489920 00000100:00100000:2.0:1788463275.741529:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 284 00000100:00100000:2.0:1788463275.741541:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2356:x1875339395489920:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463275.741598:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463275.741658:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2356:x1875339395489920:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 119us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.741668:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 284 00000100:00100000:3.0:1788463275.741776:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395490176 00000100:00100000:3.0:1788463275.741781:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395490176 00000100:00100000:3.0:1788463275.741847:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:3.0:1788463275.741856:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2353:x1875339395490176:12345-192.168.204.11@tcp:9:kworker.0 00000020:00000080:3.0:1788463275.741891:0:8660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35b25 00000100:00080000:3.0:1788463275.741906:0:8660:0:(import.c:65:import_set_state_nolock()) ffff9ba5ebffa800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463275.741968:0:8660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1788463275.742268:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788463275.742428:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463275.743459:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463275.743981:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395490304 00000100:00100000:2.0:1788463275.743994:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395490304 00000100:00100000:2.0:1788463275.744104:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00100000:2.0:1788463275.744118:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2356:x1875339395490304:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463275.744205:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2356:x1875339395490304:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 90us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463275.744213:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00080000:2.0:1788463275.744246:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463275.746990:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+2:2353:x1875339395490176:12345-192.168.204.11@tcp:9:kworker.0 Request processed in 5110us (5367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463275.747013:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00010000:00010000:1.0:1788463275.877142:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463276.902265:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463277.926235:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463278.629401:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463278.629433:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408111360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463278.629547:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463278.629952:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408111360 00000100:00100000:0.0:1788463278.629964:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408111360 00000100:00100000:0.0:1788463278.630067:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788463278.630080:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408111360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463278.630130:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463278.630200:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408111360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463278.630209:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788463278.630281:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408111360:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788463278.630367:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788463278.949122:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463279.653261:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408111744:0@lo:400:kworker.0 00000100:00100000:0.0:1788463279.653443:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408111488:0@lo:400:kworker.0 00000100:00100000:0.0:1788463279.653543:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463279.653620:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408112000:0@lo:400:kworker.0 00000100:00100000:0.0:1788463279.653664:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463279.653727:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463279.653733:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408111872:0@lo:400:kworker.0 00000100:00100000:0.0:1788463279.653756:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463279.653795:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408112000 00000100:00100000:0.0:1788463279.653805:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408112000 00000100:00100000:0.0:1788463279.653889:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408111872 00000100:00100000:0.0:1788463279.653893:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408111872 00000100:00100000:0.0:1788463279.653920:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788463279.653931:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408112000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463279.654015:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408112000:12345-0@lo:400:kworker.0 Request processed in 85us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463279.654025:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788463279.654047:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788463279.654054:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408111872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463279.654083:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408111872:12345-0@lo:400:kworker.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463279.654090:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1788463279.654119:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463279.654157:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408111872:0@lo:400:kworker.0 00000100:00100000:0.0:1788463279.654168:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408112000:0@lo:400:kworker.0 00000100:00100000:2.0:1788463279.654354:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408111488 00000100:00100000:2.0:1788463279.654360:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408111488 00000100:00100000:2.0:1788463279.654407:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788463279.654415:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408111488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463279.654461:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408111488:12345-0@lo:400:kworker.0 Request processed in 47us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463279.654467:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788463279.654509:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408111488:0@lo:400:kworker.0 00000100:00100000:3.0:1788463279.654807:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408111616:0@lo:400:kworker.0 00000100:00100000:3.0:1788463279.654845:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463279.654873:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408112128:0@lo:400:kworker.0 00000100:00100000:3.0:1788463279.654896:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463279.655053:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463279.655193:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408112128 00000100:00100000:2.0:1788463279.655199:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408112128 00000100:00100000:2.0:1788463279.655256:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408111744 00000100:00100000:2.0:1788463279.655260:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408111744 00000100:00100000:2.0:1788463279.655287:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788463279.655413:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463279.655447:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408111616 00000100:00100000:0.0:1788463279.655452:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408111616 00000100:00100000:0.0:1788463279.655480:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788463279.655487:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408111616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463279.655541:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408111616:12345-0@lo:400:kworker.0 Request processed in 54us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463279.655549:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788463279.655589:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408111616:0@lo:400:kworker.0 00000100:00100000:0.0:1788463279.655628:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788463279.655637:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408111744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463279.655764:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408112128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463279.655807:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408112128:12345-0@lo:400:kworker.0 Request processed in 513us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463279.655814:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788463279.655862:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5616d80 x1875339408112128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463279.655876:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408112128:0@lo:400:kworker.0 00000100:00100000:0.0:1788463279.656004:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408111744:12345-0@lo:400:kworker.0 Request processed in 369us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463279.656012:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788463279.656250:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408111744:0@lo:400:kworker.0 00010000:00010000:1.0:1788463279.973020:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463280.165594:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408112256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463280.165797:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463280.165992:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408112256 00000100:00100000:0.0:1788463280.166004:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408112256 00000100:00100000:0.0:1788463280.166072:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788463280.166084:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408112256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463280.166129:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463280.166187:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408112256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463280.166195:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788463280.166541:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec437800 x1875339408112256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463280.166566:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408112256:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788463280.758680:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:2.0:1788463280.758723:0:6697:0:(genops.c:885:class_export_put()) final put ffff9ba5feab3800/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:2.0:1788463280.758758:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5feab3800/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 for lustre-OST0000 00000020:00000080:2.0:1788463280.758833:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5ebffa800 for lustre-OST0000 00000100:00100000:1.0:1788463280.843412:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463280.843466:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463280.843520:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463280.843575:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395490432 00000100:00100000:2.0:1788463280.843596:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395490432 00000100:00100000:2.0:1788463280.843743:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 286 00000100:00100000:2.0:1788463280.843755:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2356:x1875339395490432:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463280.843878:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2356:x1875339395490432:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 123us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463280.843887:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 286 00000100:00100000:3.0:1788463280.846803:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395490560 00000100:00100000:3.0:1788463280.846820:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395490560 00000100:00100000:3.0:1788463280.846902:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395490688 00000100:00100000:3.0:1788463280.846907:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395490688 00000100:00100000:3.0:1788463280.847035:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 130 00000100:00100000:3.0:1788463280.847048:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395490560:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463280.847143:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395490560:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 98us (3809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463280.847150:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 130 00000100:00100000:3.0:1788463280.847174:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 131 00000100:00100000:3.0:1788463280.847180:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2356:x1875339395490688:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463280.847205:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2356:x1875339395490688:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 25us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463280.847212:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 131 00000100:00080000:2.0:1788463280.847538:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788463280.996955:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463282.021527:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788463282.098792:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788463283.049270:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463283.750059:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408112384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463283.750170:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463283.750487:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408112384 00000100:00100000:0.0:1788463283.750498:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408112384 00000100:00100000:0.0:1788463283.750575:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788463283.750585:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408112384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463283.750636:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463283.750717:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408112384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463283.750725:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788463283.751957:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463283.752047:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408112384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788463284.068928:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463284.775361:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408112512:0@lo:400:kworker.0 00000100:00100000:0.0:1788463284.775502:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463284.775621:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408112512 00000100:00100000:0.0:1788463284.775634:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408112512 00000100:00100000:0.0:1788463284.775726:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788463284.775739:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408112512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463284.775833:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3277:x1875339408112512:12345-0@lo:400:kworker.0 Request processed in 97us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463284.775842:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788463284.775934:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408112512:0@lo:400:kworker.0 00000100:00100000:2.0:1788463284.783768:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408112640:0@lo:400:kworker.0 00000100:00100000:3.0:1788463284.783928:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408112896:0@lo:400:kworker.0 00000100:00100000:2.0:1788463284.783930:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463284.783978:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463284.784001:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408113152:0@lo:400:kworker.0 00000100:00100000:3.0:1788463284.784019:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463284.784034:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408113024:0@lo:400:kworker.0 00000100:00100000:2.0:1788463284.784038:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463284.784062:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463284.784063:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463284.784067:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408112768:0@lo:400:kworker.0 00000100:00100000:2.0:1788463284.784096:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463284.784125:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408112640 00000100:00100000:2.0:1788463284.784132:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408113152 00000100:00100000:3.0:1788463284.784141:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408112640 00000100:00100000:2.0:1788463284.784141:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408113152 00000100:00100000:3.0:1788463284.784226:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408112896 00000100:00100000:2.0:1788463284.784226:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408112768 00000100:00100000:3.0:1788463284.784229:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408112896 00000100:00100000:2.0:1788463284.784229:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408112768 00000100:00100000:3.0:1788463284.784250:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408113024 00000100:00100000:3.0:1788463284.784253:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408113024 00000100:00100000:2.0:1788463284.784255:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463284.784268:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408113152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463284.784271:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788463284.784278:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408112640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463284.784437:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788463284.784450:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408112896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463284.784500:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408112896:12345-0@lo:400:kworker.0 Request processed in 53us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463284.784508:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788463284.784533:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788463284.784540:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408113024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463284.784561:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408112640:12345-0@lo:400:kworker.0 Request processed in 283us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463284.784565:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408113024:12345-0@lo:400:kworker.0 Request processed in 27us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463284.784569:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788463284.784572:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788463284.784593:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788463284.784601:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408112768:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788463284.784608:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463284.784614:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463284.784632:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408112768:12345-0@lo:400:kworker.0 Request processed in 33us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463284.784638:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788463284.784679:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408113152:12345-0@lo:400:kworker.0 Request processed in 414us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463284.784681:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408112768:0@lo:400:kworker.0 00000100:00100000:2.0:1788463284.784711:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1788463284.790596:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fed66d80 x1875339408113152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463284.790597:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408113024:0@lo:400:kworker.0 00000100:00100000:3.0:1788463284.790618:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408113152:0@lo:400:kworker.0 00000100:00100000:0.0:1788463284.790630:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408112896:0@lo:400:kworker.0 00000100:00100000:3.0:1788463284.790647:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408112640:0@lo:400:kworker.0 00010000:00010000:0.0:1788463285.102069:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463285.286071:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463285.286107:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408113280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463285.286250:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463285.287054:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408113280 00000100:00100000:0.0:1788463285.287067:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408113280 00000100:00100000:0.0:1788463285.287209:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788463285.287225:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408113280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463285.287278:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463285.287799:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408113280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 575us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463285.287809:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788463285.287912:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5ec436a00 x1875339408113280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463285.287947:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408113280:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788463285.776144:0:11843:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:21:24 (1788463284) 00000100:00100000:3.0:1788463285.963808:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463285.963938:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463285.963985:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395490816 00000100:00100000:3.0:1788463285.964000:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395490816 00000100:00100000:3.0:1788463285.964083:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 288 00000100:00100000:3.0:1788463285.964099:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395490816:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463285.964208:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395490816:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 112us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463285.964668:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 288 00000100:00100000:3.0:1788463285.965592:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395490944 00000100:00100000:3.0:1788463285.965605:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395490944 00000100:00080000:2.0:1788463285.965753:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463285.965875:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 135 00000100:00100000:3.0:1788463285.965889:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395490944:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463285.965966:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395490944:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 80us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463285.965974:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 135 00000100:00100000:1.0:1788463285.978100:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463285.978776:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395491072 00000100:00100000:3.0:1788463285.978793:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395491072 00000100:00100000:3.0:1788463285.978964:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 136 00000100:00100000:3.0:1788463285.978978:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2355:x1875339395491072:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463285.979087:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2355:x1875339395491072:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 111us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463285.979096:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 136 00000100:00080000:1.0:1788463285.980604:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788463286.120485:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463287.144003:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463288.152102:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463288.155334:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395491200 00000100:00100000:0.0:1788463288.155368:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395491200 00000100:00100000:0.0:1788463288.155515:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:0.0:1788463288.155533:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:10228:x1875339395491200:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463288.155562:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463288.155596:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35bf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ddac expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463288.155726:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35bf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463288.155745:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463288.155763:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463288.155845:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788463288.155850:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463288.155910:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463288.155944:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35bf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddac expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463288.155971:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddac expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463288.155981:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:0.0:1788463288.155985:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463288.155990:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e200, rc 0) 00000100:00100000:0.0:1788463288.156096:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:10228:x1875339395491200:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 569us (4016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463288.156104:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00080000:1.0:1788463288.156431:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463288.164877:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463288.168772:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463288.168971:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395491328 00000100:00100000:3.0:1788463288.168992:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395491328 00000100:00100000:3.0:1788463288.169098:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:3.0:1788463288.169115:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:10229:x1875339395491328:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463288.169156:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463288.169289:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35bfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ddb3 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.169406:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.169449:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.169467:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.169492:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.169500:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.169508:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.171121:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1a00/0xc3fe72277ee35c13 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.171931:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1a00/0xc3fe72277ee35c13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.171955:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1a00/0xc3fe72277ee35c13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463288.172022:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788463288.172028:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463288.172074:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1a00/0xc3fe72277ee35c13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.172093:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.172124:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.172133:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.172140:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463288.172157:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173261:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173294:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:3.0:1788463288.173297:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463288.173305:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173313:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173340:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173347:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173355:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173361:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463288.173380:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173388:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173397:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ba5c5b58500) 00010000:00010000:3.0:1788463288.173400:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463288.173404:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173410:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173490:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35bfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddb3 expref: 8 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173510:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1a00/0xc3fe72277ee35c13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddb3 expref: 7 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.173519:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ba5c5b58700) 00010000:00010000:3.0:1788463288.173521:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463288.173525:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1a00, rc 0) 00000100:00100000:3.0:1788463288.173658:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:10229:x1875339395491328:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 4545us (4906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463288.173671:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:2.0:1788463288.192111:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463288.192236:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395491584 00000100:00100000:3.0:1788463288.192255:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395491584 00000100:00100000:3.0:1788463288.192351:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:3.0:1788463288.192364:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:10229:x1875339395491584:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463288.192416:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463288.192449:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c1a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ddba expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.192579:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c21 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.192603:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.192619:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.192892:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c28 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.192920:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463288.192939:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194232:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cbe00/0xc3fe72277ee35c2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194256:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cbe00/0xc3fe72277ee35c2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194274:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cbe00/0xc3fe72277ee35c2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463288.194305:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788463288.194542:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194552:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c21 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194561:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c21 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194568:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463288.194573:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c21 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194584:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c21 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194601:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ba5c5b58700) 00010000:00010000:2.0:1788463288.194604:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463288.194609:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194617:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194634:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194640:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c28 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194657:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194662:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463288.194665:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194672:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c28 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194750:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ba5c5b58500) 00010000:00010000:2.0:1788463288.194754:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463288.194757:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c28 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.194764:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c28 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.207482:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddba expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.207559:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cbe00/0xc3fe72277ee35c2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddba expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463288.207574:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:2.0:1788463288.207578:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463288.207583:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cbe00, rc 0) 00000100:00100000:2.0:1788463288.207748:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:10229:x1875339395491584:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 15385us (15657us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788463288.207793:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:1.0:1788463288.216748:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463288.216943:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395491712 00000100:00100000:3.0:1788463288.216959:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395491712 00000100:00100000:3.0:1788463288.217049:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:3.0:1788463288.217063:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:10229:x1875339395491712:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788463288.217240:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:10229:x1875339395491712:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 Request processed in 180us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463288.217249:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 35 00000040:00080000:1.0:1788463288.232842:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788463288.870235:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463288.870279:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408113408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463288.870382:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463288.870584:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408113408 00000100:00100000:0.0:1788463288.870599:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408113408 00000100:00100000:0.0:1788463288.870738:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463288.870755:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408113408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463288.870831:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463288.870894:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408113408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463288.870902:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788463288.870987:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408113408:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788463288.871064:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463289.191666:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463289.893906:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463289.893946:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408113536:0@lo:400:kworker.0 00000100:00100000:0.0:1788463289.894003:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408113664:0@lo:400:kworker.0 00000100:00100000:0.0:1788463289.894588:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463289.894723:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408113664 00000100:00100000:3.0:1788463289.894742:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408113664 00000100:00100000:3.0:1788463289.894823:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788463289.894834:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408113664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463289.894903:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408113664:12345-0@lo:400:kworker.0 Request processed in 72us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463289.894911:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788463289.894963:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408113664:0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.894993:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463289.895078:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408113536 00000100:00100000:0.0:1788463289.895084:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408113536 00000100:00100000:0.0:1788463289.895130:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788463289.895138:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408113536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.895151:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408114048:0@lo:400:kworker.0 00000100:00100000:0.0:1788463289.895188:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408113536:12345-0@lo:400:kworker.0 Request processed in 50us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463289.895197:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788463289.895222:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463289.895254:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463289.895270:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408113920:0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.895509:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463289.895546:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408114048 00000100:00100000:1.0:1788463289.895551:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408114048 00000100:00100000:1.0:1788463289.895836:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408113920 00000100:00100000:1.0:1788463289.895841:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408113920 00000100:00100000:1.0:1788463289.895867:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788463289.895875:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408114048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.896006:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408114048:12345-0@lo:400:kworker.0 Request processed in 132us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463289.896015:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788463289.896033:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788463289.896039:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408113920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.896072:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408113920:12345-0@lo:400:kworker.0 Request processed in 33us (562us total) trans 0 rc 0/0 00000100:00080000:0.0:1788463289.896075:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463289.896080:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788463289.896134:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408113920:0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.896148:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408114048:0@lo:400:kworker.0 00000100:00100000:3.0:1788463289.896179:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408113792:0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.896195:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408113536:0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.896220:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408114176:0@lo:400:kworker.0 00000100:00100000:3.0:1788463289.896230:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463289.896255:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463289.896286:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408113792 00000100:00100000:3.0:1788463289.896291:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408113792 00000100:00100000:3.0:1788463289.896321:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788463289.896328:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408113792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.896353:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408114176 00000100:00100000:1.0:1788463289.896360:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408114176 00000100:00100000:3.0:1788463289.896367:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408113792:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463289.896376:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788463289.896401:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408113792:0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.896531:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788463289.896539:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408114176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463289.896593:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408114176:12345-0@lo:400:kworker.0 Request processed in 55us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463289.896601:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788463289.896617:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788463289.896637:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c5617480 x1875339408114176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788463305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463289.896649:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5617480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408114176:0@lo:400:kworker.0 00010000:00010000:2.0:1788463290.212928:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463290.405978:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408114304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463290.406071:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463290.406326:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408114304 00000100:00100000:0.0:1788463290.406336:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408114304 00000100:00100000:0.0:1788463290.406413:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788463290.406424:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408114304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463290.406594:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463290.406660:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408114304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 238us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463290.406669:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788463290.406768:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5fe9c9f80 x1875339408114304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463290.406786:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408114304:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788463290.505401:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:1.0:1788463290.981029:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463290.981119:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395491840 00000100:00100000:3.0:1788463290.981130:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395491840 00000100:00100000:3.0:1788463290.981230:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:3.0:1788463290.981242:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:10271:x1875339395491840:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463290.981267:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463290.981292:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ddc1 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981376:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981390:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981405:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981421:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981440:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981447:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981860:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981868:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981874:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981880:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463290.981884:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981964:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981977:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:3.0:1788463290.981980:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463290.981985:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.981991:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.982001:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.982007:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.982012:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.982017:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463290.982020:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.982026:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.982033:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ba5c5b58800) 00010000:00010000:3.0:1788463290.982036:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463290.982039:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.982054:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.982091:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddc1 expref: 9 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.982102:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:3.0:1788463290.982104:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463290.982108:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddc1 expref: 9 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463290.982117:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1600, rc 0) 00000100:00100000:3.0:1788463290.982189:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:10271:x1875339395491840:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 948us (1170us total) trans 0 rc 301/301 00000100:00100000:3.0:1788463290.982197:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00080000:1.0:1788463290.985081:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463290.988142:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463290.988237:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395492096 00000100:00100000:1.0:1788463290.988247:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395492096 00000100:00100000:1.0:1788463290.988347:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:1.0:1788463290.988359:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:10271:x1875339395492096:12345-192.168.204.11@tcp:36:lfs.0 00010000:00010000:1.0:1788463290.988443:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463290.988476:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35bf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddac expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.988499:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463290.988514:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463290.989100:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c52 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.989119:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.989132:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.989159:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.989168:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.989176:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463290.990867:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788463290.990945:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c52 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.990956:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c52 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.990963:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.990968:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463290.990973:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c52 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.990981:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c52 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.990995:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430c00) 00010000:00010000:1.0:1788463290.990999:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463290.991003:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c52 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.991021:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c52 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463290.991129:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4a99dc6 reply state 0000000097654ffc transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463290.991139:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463290.991301:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:10271:x1875339395492096:12345-192.168.204.11@tcp:36:lfs.0 Request processed in 2941us (3171us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788463290.991310:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 37 00010000:00010000:1.0:1788463290.992927:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.992941:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.992950:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.992956:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463290.992961:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.992968:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.992984:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ba5d9430500) 00010000:00010000:1.0:1788463290.992987:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463290.992992:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463290.993011:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35c59 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463291.088462:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463291.088540:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395492224 00000100:00100000:3.0:1788463291.088624:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395492224 00000100:00100000:3.0:1788463291.088759:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 290 00000100:00100000:3.0:1788463291.088774:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2356:x1875339395492224:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463291.088870:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2356:x1875339395492224:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 100us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463291.088878:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 290 00000100:00100000:2.0:1788463291.092516:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463291.092609:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463291.093127:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395492352 00000100:00100000:3.0:1788463291.093140:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395492352 00000100:00100000:3.0:1788463291.093351:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395492480 00000100:00100000:3.0:1788463291.093355:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395492480 00000100:00100000:3.0:1788463291.093385:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 140 00000100:00100000:3.0:1788463291.093404:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2357:x1875339395492352:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463291.093494:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2357:x1875339395492352:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 92us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463291.093501:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 140 00000100:00100000:3.0:1788463291.093520:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:3.0:1788463291.093526:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:10279:x1875339395492480:12345-192.168.204.11@tcp:101:lctl.0 00010000:00010000:3.0:1788463291.093543:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463291.093570:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ddc8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.093650:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.093667:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.093680:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463291.093738:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788463291.093876:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463291.093921:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.094069:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddc8 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.094087:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddc8 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.094107:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:3.0:1788463291.094111:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463291.094115:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1800, rc 0) 00000100:00100000:3.0:1788463291.094144:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:10279:x1875339395492480:12345-192.168.204.11@tcp:101:lctl.0 Request processed in 617us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463291.094151:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00080000:2.0:1788463291.100272:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463291.172983:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463291.173233:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395492608 00000100:00100000:3.0:1788463291.173247:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395492608 00000100:00100000:3.0:1788463291.173343:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:3.0:1788463291.173358:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:10286:x1875339395492608:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:3.0:1788463291.173389:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463291.173414:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ddcf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.173489:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c75 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.173505:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.173518:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.173533:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35c7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.173540:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35c7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.173569:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35c7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.173759:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0a00/0xc3fe72277ee35c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.173769:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0a00/0xc3fe72277ee35c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.173777:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0a00/0xc3fe72277ee35c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463291.173816:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788463291.173821:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463291.174514:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0a00/0xc3fe72277ee35c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174538:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174547:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c75 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174555:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174562:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463291.174568:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174576:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c75 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174593:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:2.0:1788463291.174597:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463291.174601:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174624:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35c75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174646:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35c7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174653:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35c7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174659:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35c7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174664:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463291.174667:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35c7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174674:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35c7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174733:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ba5c5b58a00) 00010000:00010000:2.0:1788463291.174748:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463291.174753:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35c7c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174760:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35c7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174808:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35c6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddcf expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174825:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0a00/0xc3fe72277ee35c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddcf expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.174840:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463291.174844:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788463291.174847:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0a00, rc 0) 00000100:00100000:2.0:1788463291.174944:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:10286:x1875339395492608:12345-192.168.204.11@tcp:101:bash.0 Request processed in 1588us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463291.174952:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:3.0:1788463291.183001:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.183216:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395492864 00000100:00100000:1.0:1788463291.183227:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395492864 00000100:00100000:1.0:1788463291.183301:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:1.0:1788463291.183312:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:10286:x1875339395492864:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:1.0:1788463291.183335:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463291.183368:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35c8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ddd6 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.183502:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35c91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.183518:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35c91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.183530:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35c91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.183579:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.183587:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.183593:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463291.184524:0:5817:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788463291.184807:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.184819:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.184829:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.184867:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35c91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.184876:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35c91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.184884:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35c91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.184902:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463291.184907:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35c91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.184916:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35c91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.184928:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:1.0:1788463291.184931:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463291.184935:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35c91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.184954:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35c91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463291.184968:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7a18726 reply state 000000006c4c4c93 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463291.184977:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788463291.185008:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35c8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddd6 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.185023:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddd6 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.185042:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5d9430c00) 00010000:00010000:1.0:1788463291.185045:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463291.185048:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489e00, rc 0) 00000100:00100000:1.0:1788463291.185575:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:10286:x1875339395492864:12345-192.168.204.11@tcp:101:bash.0 Request processed in 2261us (2581us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788463291.185584:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 40 00010000:00010000:1.0:1788463291.191592:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.191614:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.191624:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.191630:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463291.191654:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.191662:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.191681:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5d9430500) 00010000:00010000:1.0:1788463291.191719:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463291.191724:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.191730:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35c98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463291.194489:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463291.194616:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395492992 00000100:00100000:0.0:1788463291.194642:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395492992 00000100:00100000:0.0:1788463291.194724:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:0.0:1788463291.194734:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875339395492992:12345-192.168.204.11@tcp:8:bash.0 00010000:00080000:0.0:1788463291.194790:0:6665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:0.0:1788463291.194828:0:6665:0:(genops.c:1385:class_connect()) connect: client c87dc105-ebf6-45f0-8943-2a25b33dd5b8, cookie 0xc3fe72277ee35cad 00002000:00100000:0.0:1788463291.194841:0:6665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c87dc105-ebf6-45f0-8943-2a25b33dd5b8/ffff9ba5f7f73800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788463291.194853:0:6665:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788463291.195295:0:6665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788463291.195331:0:6665:0:(import.c:65:import_set_state_nolock()) ffff9ba5f7f70800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463291.195425:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2353:x1875339395492992:12345-192.168.204.11@tcp:8:bash.0 Request processed in 690us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463291.195435:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:2.0:1788463291.197774:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.197831:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395493120 00000100:00100000:1.0:1788463291.197842:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395493120 00000100:00100000:1.0:1788463291.197929:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:1.0:1788463291.197941:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:0:x1875339395493120:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:1.0:1788463291.197962:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463291.197997:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35cb4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dddd expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463291.198036:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463291.198060:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:1.0:1788463291.198066:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463291.198078:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dddd expref: 7 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.198105:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dddd expref: 7 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.198139:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488800, rc 0) 00000100:00100000:1.0:1788463291.198213:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:0:x1875339395493120:12345-192.168.204.11@tcp:101:bash.0 Request processed in 274us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463291.198220:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00080000:2.0:1788463291.198887:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463291.201500:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463291.202439:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395493248 00000100:00100000:0.0:1788463291.202461:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395493248 00000100:00100000:0.0:1788463291.202556:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:0.0:1788463291.202569:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:10286:x1875339395493248:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:0.0:1788463291.202594:0:8660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463291.202616:0:8660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dde4 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.202662:0:8660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35cb4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dddd expref: 8 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.202675:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463291.202680:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463291.202711:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 8 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.202791:0:8660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dddd expref: 8 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.202806:0:8660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35cb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dddd expref: 8 pid: 6667 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463291.202821:0:8660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8660:1875339408114432:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463291.202913:0:8660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c2ed8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463291.207284:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463291.207443:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395493376 00000100:00100000:3.0:1788463291.207455:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395493376 00010000:00010000:3.0:1788463291.207510:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35cb4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dddd expref: 9 pid: 6667 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463291.207570:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:3.0:1788463291.207582:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2354:x1875339395493376:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463291.207603:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463291.207636:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35cb4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dddd expref: 9 pid: 6667 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.207653:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35cb4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dddd expref: 9 pid: 6667 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.207773:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463291.207780:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463291.207791:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 9 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.207803:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 9 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.207844:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 9 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463291.207858:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed65180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5802:1875339408114560:192.168.204.11@tcp:105: 00000100:00100000:3.0:1788463291.207968:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481d80 going to sleep for 11 seconds 00010000:00010000:2.0:1788463291.208812:0:8660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35cb4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dddd expref: 9 pid: 6667 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463291.208835:0:8660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8660:1875339408114432:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463291.208865:0:8660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 8 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463291.208879:0:8660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f000, rc 0) 00000100:00100000:2.0:1788463291.208971:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:10286:x1875339395493248:12345-192.168.204.11@tcp:101:bash.0 Request processed in 6404us (7484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463291.208980:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:3.0:1788463291.213986:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed65180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5802:1875339408114560:192.168.204.11@tcp:105: 00010000:00010000:3.0:1788463291.214018:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463291.215326:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395493376:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 7736us (8045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463291.215341:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:0.0:1788463291.216858:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.216951:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395493632 00000100:00100000:1.0:1788463291.216961:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395493632 00000100:00100000:1.0:1788463291.217053:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1788463291.217066:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:10286:x1875339395493632:12345-192.168.204.11@tcp:35:bash.0 00000100:00100000:1.0:1788463291.217507:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:10286:x1875339395493632:12345-192.168.204.11@tcp:35:bash.0 Request processed in 442us (661us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788463291.217517:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00010000:00010000:3.0:1788463291.237023:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463291.362316:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.362673:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395493888 00000100:00100000:1.0:1788463291.362722:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395493888 00000100:00100000:1.0:1788463291.362816:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:1.0:1788463291.362826:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:10296:x1875339395493888:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463291.362854:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463291.362880:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35cc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ddeb expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463291.363264:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788463291.363421:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35cc2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddeb expref: 15 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.363441:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:1.0:1788463291.363461:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463291.363469:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35cc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddeb expref: 15 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.363485:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488600, rc 0) 00000100:00100000:1.0:1788463291.363759:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:10296:x1875339395493888:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 933us (1452us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788463291.363768:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:0.0:1788463291.382144:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463291.382651:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395494144 00000100:00100000:2.0:1788463291.382715:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395494144 00000100:00100000:2.0:1788463291.382817:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:2.0:1788463291.382831:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:10296:x1875339395494144:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:2.0:1788463291.383137:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:10296:x1875339395494144:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 309us (1005us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788463291.383145:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:2.0:1788463291.473328:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.473435:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395494272 00000100:00100000:1.0:1788463291.473445:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395494272 00000100:00100000:1.0:1788463291.473505:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:1.0:1788463291.473516:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:10302:x1875339395494272:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463291.473539:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463291.473561:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ddf2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.473634:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.473649:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.473663:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463291.473754:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788463291.473759:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463291.473779:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.473902:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddf2 expref: 17 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.473923:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddf2 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.473932:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:1.0:1788463291.473935:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463291.473939:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489000, rc 0) 00000100:00100000:1.0:1788463291.474004:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:10302:x1875339395494272:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 490us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463291.474010:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:3.0:1788463291.478053:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.478560:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395494528 00000100:00100000:1.0:1788463291.478571:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395494528 00000100:00100000:1.0:1788463291.478631:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:1.0:1788463291.478642:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:10302:x1875339395494528:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463291.478661:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463291.479053:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35cde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ddf9 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.479251:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35ce5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.479270:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.479284:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463291.479317:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788463291.479566:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35cde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddf9 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.479589:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddf9 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.479599:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5d9430c00) 00010000:00010000:1.0:1788463291.479603:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463291.479607:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488600, rc 0) 00000100:00100000:1.0:1788463291.479945:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:10302:x1875339395494528:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1168us (1766us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788463291.479957:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:0.0:1788463291.487898:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463291.487987:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463291.488116:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395494784 00000100:00100000:3.0:1788463291.488126:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395494784 00000100:00100000:3.0:1788463291.488194:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:3.0:1788463291.488205:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:10302:x1875339395494784:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463291.488234:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463291.488257:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35cf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de00 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.488380:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35cfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.488398:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.488410:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463291.488544:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788463291.488669:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35cf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de00 expref: 21 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.488719:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de00 expref: 20 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.488728:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5d9430c00) 00010000:00010000:3.0:1788463291.488743:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788463291.488747:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0200, rc 0) 00000100:00100000:3.0:1788463291.488810:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:10302:x1875339395494784:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 606us (931us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788463291.488817:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:3.0:1788463291.488848:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395494912 00000100:00100000:3.0:1788463291.488853:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395494912 00000100:00100000:3.0:1788463291.488894:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:3.0:1788463291.488902:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:2354:x1875339395494912:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463291.488912:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463291.488933:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35ce5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddf9 expref: 20 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.488945:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5d9430c00) 00010000:00010000:3.0:1788463291.488948:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463291.488969:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:2354:x1875339395494912:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 68us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463291.488976:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:2.0:1788463291.496326:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.496677:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395495040 00000100:00100000:1.0:1788463291.497171:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395495040 00000100:00100000:1.0:1788463291.497279:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:1.0:1788463291.497292:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2357:x1875339395495040:12345-192.168.204.11@tcp:1:lfs.0 00010000:00010000:1.0:1788463291.497345:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.497371:0:6667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 7 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.497381:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788463291.497386:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463291.497391:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.497457:0:6667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 7 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.497475:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 7 pid: 8660 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463291.497491:0:6667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6667:1875339408114688:192.168.204.11@tcp:104: 00000100:00100000:1.0:1788463291.497597:0:6667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c3e0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463291.501591:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463291.501677:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395495168 00000100:00100000:3.0:1788463291.501714:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395495168 00002000:00100000:3.0:1788463291.501780:0:6671:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ba5ec485880 x1875339395495168/t0(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:427/0 lens 504/0 e 0 to 0 dl 1788463302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463291.501791:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5ec485880 with x1875339395495168 ext(0->12) 00010000:00010000:3.0:1788463291.501801:0:6671:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 8 pid: 8660 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.501817:0:6671:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 8 pid: 8660 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463291.501826:0:6671:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ba5ec485880 00000100:00100000:3.0:1788463291.501849:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1788463291.501859:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395495168:12345-192.168.204.11@tcp:4:lfs.0 00000100:00100000:1.0:1788463291.506085:0:6667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6667:1875339408114688:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463291.506116:0:6667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788463291.547492:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000001:00080000:2.0:1788463291.597056:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1788463291.597334:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395495168:12345-192.168.204.11@tcp:4:lfs.0 Request processed in 95468us (95744us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788463291.597355:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00002000:00100000:0.0:1788463291.597369:0:6671:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ba5ec485880 x1875339395495168/t4294967299(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:427/0 lens 504/448 e 0 to 0 dl 1788463302 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463291.597380:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5ec485880 with x1875339395495168 ext(0->12) 00010000:00010000:0.0:1788463291.597403:0:6671:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 7 pid: 8660 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.597579:0:6671:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 7 pid: 8660 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463291.597588:0:6671:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ba5ec485880 00000100:00100000:0.0:1788463291.600721:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463291.600891:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395495296 00000100:00100000:3.0:1788463291.600901:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395495296 00010000:00010000:3.0:1788463291.601002:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 7 pid: 8660 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463291.601070:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:3.0:1788463291.601194:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2357:x1875339395495296:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463291.601213:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788463291.601234:0:5803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788463291.601238:0:5803:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788463291 00002000:00010000:3.0:1788463291.601240:0:5803:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788463291 00002000:00010000:3.0:1788463291.601243:0:5803:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788463291 00002000:00010000:3.0:1788463291.601245:0:5803:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788463291.601252:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 7 pid: 8660 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.601266:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 7 pid: 8660 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.601292:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000451e3789/0xc3fe72277ee35cbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dde4 expref: 7 pid: 8660 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.601312:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463291.601316:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463291.601322:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.601332:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.601552:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463291.601612:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395495296:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 533us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463291.601621:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 36 00010000:00010000:1.0:1788463291.603031:0:6667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.603049:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.603138:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.603149:0:6667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.603177:0:6667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.603184:0:6667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463291.603189:0:6667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.603200:0:6667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.603218:0:6667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.603226:0:6667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee35d08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463291.603346:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395495040:12345-192.168.204.11@tcp:1:lfs.0 Request processed in 106054us (107026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463291.603357:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:0.0:1788463291.606259:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463291.606355:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395495552 00000100:00100000:2.0:1788463291.606365:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395495552 00000100:00100000:2.0:1788463291.606575:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:2.0:1788463291.606587:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:10302:x1875339395495552:12345-192.168.204.11@tcp:35:lfs.0 00000004:00010000:2.0:1788463291.606653:0:5820:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de00 expref: 19 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463291.607143:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788463291.607195:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788463291.608872:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788463291.609022:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.609044:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddd6 expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.609054:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.609096:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddd6 expref: 23 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.609115:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddd6 expref: 23 pid: 5817 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463291.609130:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed64a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5820:1875339408114816:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463291.609238:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481480 going to sleep for 11 seconds 00000100:00100000:0.0:1788463291.612877:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed64a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5820:1875339408114816:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463291.612913:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463291.614376:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463291.616363:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395495680 00000100:00100000:3.0:1788463291.616379:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395495680 00010000:00010000:3.0:1788463291.617204:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddd6 expref: 24 pid: 5817 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463291.617280:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:3.0:1788463291.617291:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:2355:x1875339395495680:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463291.617307:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463291.617313:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddd6 expref: 24 pid: 5817 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.617327:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddd6 expref: 24 pid: 5817 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.617349:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35c9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddd6 expref: 24 pid: 5817 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.617367:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5d9430c00) 00010000:00010000:3.0:1788463291.617373:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.617383:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.617391:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.617443:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463291.617503:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec485f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:2355:x1875339395495680:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 214us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463291.617511:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 37 00010000:00010000:1.0:1788463291.617637:0:5820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.617648:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463291.617812:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788463291.618025:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788463291.618143:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1875339408114944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788463291.618208:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463291.618244:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec39bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463291.618560:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408114944 00000100:00100000:3.0:1788463291.618576:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408114944 00000100:00100000:3.0:1788463291.618642:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463291.618651:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1875339408114944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788463291.618770:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1875339408114944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 120us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463291.618779:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788463291.618823:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1875339408114944:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1788463291.620079:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788463291.622712:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788463291.622877:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec487800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1875339408115072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788463291.622970:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463291.623014:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463291.623215:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408115072 00000100:00100000:3.0:1788463291.623224:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408115072 00000100:00100000:3.0:1788463291.623285:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463291.623297:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5820:x1875339408115072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788463291.623595:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5820:x1875339408115072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 300us (625us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788463291.623603:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463291.623823:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec487800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5820:1875339408115072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788463291.623893:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788463291.623937:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.623949:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.623957:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.623963:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463291.623980:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.623989:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.624007:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5d9430c00) 00010000:00010000:0.0:1788463291.624010:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788463291.624014:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.624021:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35d0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788463291.624209:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788463291.624439:0:5820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788463291.624450:0:5820:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323234764985ns, next at 324234763270ns, rc = 0 00000001:00080000:0.0:1788463291.624456:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788463291.624488:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5d9430c00) 00010000:00010000:0.0:1788463291.624491:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788463291.624498:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35cfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de00 expref: 27 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463291.624593:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:10302:x1875339395495552:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 18007us (18343us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788463291.624605:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000020:00080000:0.0:1788463291.624609:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788463291.638597:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463291.638717:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395495808 00000100:00100000:3.0:1788463291.638740:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395495808 00000100:00100000:3.0:1788463291.638811:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:3.0:1788463291.638822:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:10302:x1875339395495808:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463291.638847:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463291.638873:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35d16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de07 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.638946:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de07 expref: 27 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.638963:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de07 expref: 27 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463291.639004:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:3.0:1788463291.639007:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463291.639012:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1000, rc 0) 00000100:00100000:3.0:1788463291.639070:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:10302:x1875339395495808:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 250us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463291.639077:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:3.0:1788463291.644154:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.644245:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395496064 00000100:00100000:1.0:1788463291.644256:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395496064 00000100:00100000:1.0:1788463291.644324:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1788463291.644335:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:10302:x1875339395496064:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:1.0:1788463291.644571:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05e9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+28:10302:x1875339395496064:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 237us (425us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788463291.644580:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:0.0:1788463291.785231:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.785335:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395496320 00000100:00100000:1.0:1788463291.785347:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395496320 00000100:00100000:1.0:1788463291.785408:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:1.0:1788463291.785419:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+28:10312:x1875339395496320:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463291.785447:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463291.785469:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de0e expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463291.785581:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788463291.785811:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de0e expref: 30 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.785830:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:1.0:1788463291.785834:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463291.785840:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de0e expref: 30 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.786071:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488800, rc 0) 00000100:00100000:1.0:1788463291.786207:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:10312:x1875339395496320:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 789us (987us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788463291.786215:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:3.0:1788463291.792380:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463291.792476:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395496448 00000100:00100000:0.0:1788463291.792500:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395496448 00000100:00100000:0.0:1788463291.792572:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:0.0:1788463291.792583:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:10312:x1875339395496448:12345-192.168.204.11@tcp:34:lfs.0 00010000:00010000:0.0:1788463291.792676:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.792909:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.792925:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.792956:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35d32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.792964:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.792971:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793089:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793099:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793107:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463291.793152:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793182:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793189:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793197:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793204:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463291.793209:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793217:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793229:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:0.0:1788463291.793233:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463291.793238:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793245:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793258:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793265:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35d32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793270:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793281:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463291.793284:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793290:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35d32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793297:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5c519aa00) 00010000:00010000:0.0:1788463291.793299:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463291.793303:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35d32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793309:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35d32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793327:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793334:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793340:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793346:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463291.793349:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793356:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793373:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:0.0:1788463291.793376:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463291.793379:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463291.793386:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463291.793488:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:10312:x1875339395496448:12345-192.168.204.11@tcp:34:lfs.0 Request processed in 904us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463291.793497:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:0.0:1788463291.804298:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.804419:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395496704 00000100:00100000:1.0:1788463291.804431:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395496704 00000100:00100000:1.0:1788463291.804565:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:1.0:1788463291.804577:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:10312:x1875339395496704:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:1.0:1788463291.804888:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:10312:x1875339395496704:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 313us (600us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788463291.804897:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:2.0:1788463291.880177:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.880332:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395496960 00000100:00100000:1.0:1788463291.880347:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395496960 00000100:00100000:1.0:1788463291.880428:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:1.0:1788463291.880441:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:10315:x1875339395496960:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463291.880478:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463291.880513:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de15 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.880636:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35d47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.880657:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.880671:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.880751:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.880759:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.880766:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.880950:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.880960:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.880967:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463291.880979:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788463291.881085:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881094:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35d47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881101:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881108:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463291.881113:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881131:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35d47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881144:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:1.0:1788463291.881147:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463291.881153:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881160:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881174:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881180:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881186:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881191:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463291.881193:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881199:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881207:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5d9430200) 00010000:00010000:1.0:1788463291.881209:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463291.881212:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881229:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881274:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de15 expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881289:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de15 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.881296:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:1.0:1788463291.881298:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463291.881300:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489e00, rc 0) 00000100:00100000:1.0:1788463291.881375:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:10315:x1875339395496960:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 935us (1217us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788463291.881382:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:3.0:1788463291.888667:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463291.888817:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395497088 00000100:00100000:1.0:1788463291.888828:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395497088 00000100:00100000:1.0:1788463291.888887:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:1.0:1788463291.888897:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:10315:x1875339395497088:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:1.0:1788463291.888966:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.888983:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.888995:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.889041:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.889048:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.889055:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.889062:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463291.889066:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.889074:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.889098:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:1.0:1788463291.889100:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463291.889106:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463291.889112:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463291.889190:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:10315:x1875339395497088:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 294us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463291.889198:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:0.0:1788463291.895173:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463291.895484:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395497344 00000100:00100000:2.0:1788463291.895494:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395497344 00000100:00100000:2.0:1788463291.895556:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:2.0:1788463291.895567:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:10315:x1875339395497344:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:2.0:1788463291.895863:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:10315:x1875339395497344:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 297us (711us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788463291.895871:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:2.0:1788463292.249051:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463292.249168:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395497600 00000100:00100000:0.0:1788463292.249178:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395497600 00000100:00100000:0.0:1788463292.249257:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:0.0:1788463292.249270:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:10346:x1875339395497600:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:0.0:1788463292.249295:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463292.249317:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de1c expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.249428:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.249443:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.249456:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788463292.249605:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788463292.249835:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788463292.249997:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35d6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de1c expref: 36 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.250022:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de1c expref: 35 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.250031:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:0.0:1788463292.250035:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463292.250039:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f800, rc 0) 00000100:00100000:0.0:1788463292.250166:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:10346:x1875339395497600:12345-192.168.204.11@tcp:101:cat.0 Request processed in 900us (1127us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788463292.250175:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 50 00010000:00010000:1.0:1788463292.262424:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463292.263044:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463292.263287:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395497728 00000100:00100000:2.0:1788463292.263297:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395497728 00000100:00100000:2.0:1788463292.263366:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:2.0:1788463292.263377:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c8993450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:2355:x1875339395497728:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463292.263394:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463292.263422:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de1c expref: 35 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.263441:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:2.0:1788463292.263446:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463292.263506:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c8993450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:2355:x1875339395497728:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 131us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463292.263513:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:0.0:1788463292.272527:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463292.272637:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395497984 00000100:00100000:2.0:1788463292.272652:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395497984 00000100:00100000:2.0:1788463292.272759:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:2.0:1788463292.272771:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:10346:x1875339395497984:12345-192.168.204.11@tcp:35:cat.0 00000100:00100000:2.0:1788463292.273548:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:10346:x1875339395497984:12345-192.168.204.11@tcp:35:cat.0 Request processed in 773us (1025us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788463292.273558:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00000040:00080000:0.0:1788463292.328416:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788463292.432296:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463292.432469:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395498240 00000100:00100000:1.0:1788463292.432508:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395498240 00000100:00100000:1.0:1788463292.432584:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:1.0:1788463292.432596:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:10352:x1875339395498240:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:1.0:1788463292.432624:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463292.432628:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788463292.432663:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddf2 expref: 35 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.432967:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:1.0:1788463292.432973:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463292.432991:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d7f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de23 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.433186:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.433201:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de15 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.433210:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.433249:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de15 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.433264:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de15 expref: 35 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463292.433278:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1875339408115200:192.168.204.11@tcp:104: 00000100:00100000:1.0:1788463292.433425:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec39bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463292.440662:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1875339408115200:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463292.440753:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463292.447102:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463292.449212:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395498368 00000100:00100000:3.0:1788463292.449226:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395498368 00010000:00010000:3.0:1788463292.449275:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de15 expref: 36 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463292.449364:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:3.0:1788463292.449374:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+36:2354:x1875339395498368:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463292.449388:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463292.449394:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de15 expref: 36 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.449408:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de15 expref: 36 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.449429:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de15 expref: 36 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.449466:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:3.0:1788463292.449471:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.449491:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.449499:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.449527:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463292.449594:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:2354:x1875339395498368:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 222us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463292.449601:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 38 00010000:00010000:1.0:1788463292.449655:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.449663:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463292.449680:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788463292.449937:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35d7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de23 expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.449954:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de23 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.449962:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:1.0:1788463292.449964:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788463292.449967:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488a00, rc 0) 00000100:00100000:1.0:1788463292.449991:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:10352:x1875339395498240:12345-192.168.204.11@tcp:101:dd.0 Request processed in 17399us (17706us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788463292.449999:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:0.0:1788463292.458606:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463292.458793:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395498624 00000100:00100000:3.0:1788463292.458808:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395498624 00000100:00100000:3.0:1788463292.458875:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:3.0:1788463292.458887:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:10352:x1875339395498624:12345-192.168.204.11@tcp:36:dd.0 00010000:00010000:3.0:1788463292.459275:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.459299:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.459317:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463292.459380:0:8863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788463292.459403:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000854ee245 reply state 00000000727201a5 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463292.459427:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463292.459556:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:10352:x1875339395498624:12345-192.168.204.11@tcp:36:dd.0 Request processed in 671us (967us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788463292.459565:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 52 00000020:00080000:3.0:1788463292.459571:0:8863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788463292.472826:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.472860:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.472905:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.472913:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463292.472919:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.472931:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.472960:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:1.0:1788463292.472964:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463292.472970:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.472977:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35d94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463292.740730:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463292.741340:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395498752 00000100:00100000:3.0:1788463292.741354:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395498752 00000100:00100000:3.0:1788463292.741427:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:3.0:1788463292.741437:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:10366:x1875339395498752:12345-192.168.204.11@tcp:101:stat.0 00010000:00010000:3.0:1788463292.741460:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463292.741480:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35d9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de2a expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741548:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35da2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741562:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741574:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741588:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35da9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741595:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741602:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741736:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741749:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de23 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741757:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741787:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de23 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463292.741801:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de23 expref: 38 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463292.741814:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1875339408115328:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463292.742149:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481600 going to sleep for 11 seconds 00000100:00100000:2.0:1788463292.748595:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463292.748748:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395499008 00000100:00100000:1.0:1788463292.748759:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395499008 00000100:00100000:1.0:1788463292.748820:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:1.0:1788463292.748830:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+39:5594:x1875339395499008:12345-192.168.204.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788463292.749198:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+40:5594:x1875339395499008:12345-192.168.204.11@tcp:35:ldlm_bl.0 Request processed in 368us (615us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788463292.749206:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:3.0:1788463292.749498:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed64e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1875339408115328:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463292.749532:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463292.752268:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463292.752388:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395499136 00000100:00100000:0.0:1788463292.752400:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395499136 00010000:00010000:0.0:1788463292.752459:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de23 expref: 40 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463292.752509:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:0.0:1788463292.752521:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+40:2355:x1875339395499136:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463292.752562:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463292.752572:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de23 expref: 40 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.752589:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de23 expref: 40 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.752619:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35d86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de23 expref: 40 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.752642:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:0.0:1788463292.752649:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.752663:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.752672:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463292.752794:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463292.752874:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+39:2355:x1875339395499136:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 354us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463292.752883:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 39 00010000:00010000:2.0:1788463292.753251:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753261:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463292.753329:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788463292.753334:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463292.753376:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753389:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753399:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753406:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35da2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753412:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35da2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753418:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463292.753422:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35da2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753430:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35da2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753441:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463292.753444:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463292.753448:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35da2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753455:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35da2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753478:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753484:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35da9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753490:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753496:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463292.753499:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753505:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35da9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753513:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5c5b58c00) 00010000:00010000:2.0:1788463292.753515:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463292.753518:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35da9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753524:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35da9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753565:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35d9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de2a expref: 39 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753580:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de2a expref: 38 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463292.753597:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:2.0:1788463292.753600:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463292.753607:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0800, rc 0) 00000100:00100000:2.0:1788463292.753654:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:10366:x1875339395498752:12345-192.168.204.11@tcp:101:stat.0 Request processed in 12218us (12970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463292.753662:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:2.0:1788463292.858530:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463292.858666:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395499392 00000100:00100000:1.0:1788463292.858678:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395499392 00000100:00100000:1.0:1788463292.858803:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 54 00000100:00100000:1.0:1788463292.858814:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:10372:x1875339395499392:12345-192.168.204.11@tcp:36:truncate.0 00010000:00010000:1.0:1788463292.858901:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463292.858930:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35db0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de2a expref: 38 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.858952:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:1.0:1788463292.858958:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463292.859437:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.859457:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.859477:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463292.859544:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788463292.859571:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000149eebcd reply state 000000007e41e754 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463292.859582:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463292.859974:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+40:10372:x1875339395499392:12345-192.168.204.11@tcp:36:truncate.0 Request processed in 1158us (1461us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788463292.859982:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 54 00000020:00080000:1.0:1788463292.859988:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788463292.867202:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.867224:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.867232:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.867253:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463292.867259:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.867268:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.867292:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:1.0:1788463292.867295:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463292.867300:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463292.867306:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35db7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463293.013529:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463293.013635:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395499520 00000100:00100000:0.0:1788463293.013646:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395499520 00000100:00100000:0.0:1788463293.013744:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:0.0:1788463293.013756:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+39:10386:x1875339395499520:12345-192.168.204.11@tcp:101:stat.0 00010000:00010000:0.0:1788463293.013797:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463293.013819:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35dbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de31 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.013882:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35dc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.013897:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.013908:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.013922:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35dcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.013929:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.013936:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014067:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014076:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014083:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463293.014120:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788463293.014131:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463293.014160:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014173:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014181:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014188:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35dc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014195:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014201:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463293.014206:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014213:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014225:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:0.0:1788463293.014228:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463293.014233:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35dc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014239:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35dc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014254:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014269:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35dcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014275:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35dcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014280:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463293.014282:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35dcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014289:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35dcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014297:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5c519aa00) 00010000:00010000:0.0:1788463293.014299:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463293.014302:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35dcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014308:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35dcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014343:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35dbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de31 expref: 41 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014357:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de31 expref: 40 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.014365:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:0.0:1788463293.014368:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463293.014376:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f800, rc 0) 00000100:00100000:0.0:1788463293.014447:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+40:10386:x1875339395499520:12345-192.168.204.11@tcp:101:stat.0 Request processed in 693us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463293.014454:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:0.0:1788463293.117199:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463293.117374:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395499776 00000100:00100000:2.0:1788463293.117389:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395499776 00000100:00100000:2.0:1788463293.117482:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:2.0:1788463293.117496:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+40:10396:x1875339395499776:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463293.117527:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463293.117556:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de38 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463293.117665:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788463293.117887:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35dda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de38 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.117900:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:2.0:1788463293.117903:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463293.117909:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de38 expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.117923:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8ca600, rc 0) 00000100:00100000:2.0:1788463293.118250:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+41:10396:x1875339395499776:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 756us (1066us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788463293.118258:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:2.0:1788463293.124147:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463293.124256:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395500032 00000100:00100000:1.0:1788463293.124267:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395500032 00000100:00100000:1.0:1788463293.124338:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:1.0:1788463293.124350:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+41:10396:x1875339395500032:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:1.0:1788463293.124676:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+42:10396:x1875339395500032:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 327us (540us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788463293.124765:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:0.0:1788463293.192305:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463293.192558:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395500288 00000100:00100000:1.0:1788463293.192572:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395500288 00000100:00100000:1.0:1788463293.192656:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:1.0:1788463293.192670:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+42:10402:x1875339395500288:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:1.0:1788463293.192757:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463293.192802:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35de8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de3f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.192962:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.192984:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de31 expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.192995:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.193042:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de31 expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.193367:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de31 expref: 43 pid: 5818 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463293.193387:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1875339408115456:192.168.204.11@tcp:104: 00000100:00100000:1.0:1788463293.193535:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec39b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463293.199303:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463293.199519:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395500416 00000100:00100000:2.0:1788463293.199531:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395500416 00010000:00010000:2.0:1788463293.199591:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de31 expref: 44 pid: 5818 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463293.199649:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:2.0:1788463293.199662:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+44:2354:x1875339395500416:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463293.199718:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463293.199728:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de31 expref: 44 pid: 5818 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.199744:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de31 expref: 44 pid: 5818 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.199778:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:2.0:1788463293.199784:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.199795:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.199803:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.199830:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463293.199925:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+44:2354:x1875339395500416:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 264us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463293.199932:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 40 00010000:00010000:1.0:1788463293.201316:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35dd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de31 expref: 43 pid: 5818 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463293.201343:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1875339408115456:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463293.201376:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.201387:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.201414:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463293.201444:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788463293.201760:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35de8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de3f expref: 44 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.201785:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de3f expref: 43 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.201794:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:1.0:1788463293.201796:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788463293.201800:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489000, rc 0) 00000100:00100000:1.0:1788463293.201893:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+43:10402:x1875339395500288:12345-192.168.204.11@tcp:101:bash.0 Request processed in 9226us (9602us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788463293.201905:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:0.0:1788463293.205661:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463293.205870:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395500672 00000100:00100000:1.0:1788463293.205886:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395500672 00000100:00100000:1.0:1788463293.206118:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:1.0:1788463293.206132:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+43:10402:x1875339395500672:12345-192.168.204.11@tcp:36:bash.0 00010000:00010000:1.0:1788463293.206537:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.206557:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.206571:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463293.206646:0:8864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788463293.206668:0:8864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb2f25b4 reply state 00000000cedb7d11 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463293.206676:0:8864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463293.206845:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+46:10402:x1875339395500672:12345-192.168.204.11@tcp:36:bash.0 Request processed in 714us (1195us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788463293.206853:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 58 00000020:00080000:1.0:1788463293.206860:0:8864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788463293.208560:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.208581:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.208590:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.208597:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463293.208604:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.208614:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.208641:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:1.0:1788463293.208644:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463293.208652:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.208657:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35dfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463293.212295:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463293.212904:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395500800 00000100:00100000:2.0:1788463293.212918:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395500800 00000100:00100000:2.0:1788463293.212997:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:2.0:1788463293.213010:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+45:10402:x1875339395500800:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1788463293.213047:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463293.213302:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35e04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de46 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.213421:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.213438:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de3f expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.213446:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.213484:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de3f expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.213495:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de3f expref: 46 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463293.213507:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1875339408115584:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463293.213607:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cc0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463293.216530:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1875339408115584:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463293.216586:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463293.216830:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463293.217028:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395500928 00000100:00100000:2.0:1788463293.217039:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395500928 00010000:00010000:2.0:1788463293.217253:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de3f expref: 47 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463293.217301:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:2.0:1788463293.217314:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+47:2355:x1875339395500928:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463293.217337:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463293.217344:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de3f expref: 47 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.217359:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de3f expref: 47 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.217392:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35def lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de3f expref: 47 pid: 5816 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.217412:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:2.0:1788463293.217418:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.217430:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.217440:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.217478:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463293.217543:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.217552:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463293.217565:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+46:2355:x1875339395500928:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 252us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463293.217587:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 41 00000004:00200000:0.0:1788463293.217615:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788463293.217621:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463293.217662:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.217748:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35e04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de46 expref: 46 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.217767:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de46 expref: 45 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.217776:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:0.0:1788463293.217779:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463293.217791:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8ca600, rc 0) 00000100:00100000:0.0:1788463293.217819:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+45:10402:x1875339395500800:12345-192.168.204.11@tcp:101:bash.0 Request processed in 4813us (5539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463293.217830:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:2.0:1788463293.221593:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463293.221680:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395501184 00000100:00100000:1.0:1788463293.221825:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395501184 00000100:00100000:1.0:1788463293.221903:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:1.0:1788463293.221918:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05ea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+45:10402:x1875339395501184:12345-192.168.204.11@tcp:35:bash.0 00000100:00100000:1.0:1788463293.222513:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05ea850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+46:10402:x1875339395501184:12345-192.168.204.11@tcp:35:bash.0 Request processed in 596us (931us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788463293.222521:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00010000:00010000:1.0:1788463293.285883:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463293.327430:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463293.327812:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395501440 00000100:00100000:1.0:1788463293.327826:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395501440 00000100:00100000:1.0:1788463293.327910:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:1.0:1788463293.327922:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+46:10412:x1875339395501440:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463293.327968:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463293.327995:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de4d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463293.328153:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788463293.328304:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de4d expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.328328:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:1.0:1788463293.328331:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463293.328339:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de4d expref: 48 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.328358:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488000, rc 0) 00000100:00100000:1.0:1788463293.328471:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+47:10412:x1875339395501440:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 550us (1056us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1788463293.328480:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:0.0:1788463293.335540:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463293.335752:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395501568 00000100:00100000:1.0:1788463293.335767:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395501568 00000100:00100000:1.0:1788463293.335845:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:1.0:1788463293.335855:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+47:10412:x1875339395501568:12345-192.168.204.11@tcp:34:lfs.0 00010000:00010000:1.0:1788463293.335984:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e20 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336008:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336020:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336041:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336187:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336195:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336316:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336327:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336334:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463293.336425:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336443:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e20 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336450:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336459:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336466:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463293.336472:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336482:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336501:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:1.0:1788463293.336504:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463293.336512:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336520:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee35e20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336539:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336546:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336558:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336563:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463293.336566:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336572:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336580:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5d9430200) 00010000:00010000:1.0:1788463293.336582:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463293.336585:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336591:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336609:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336617:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336623:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336627:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463293.336630:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336645:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336655:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:1.0:1788463293.336657:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463293.336660:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.336666:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463293.336969:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+47:10412:x1875339395501568:12345-192.168.204.11@tcp:34:lfs.0 Request processed in 1111us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463293.336979:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:3.0:1788463293.340371:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463293.340498:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395501824 00000100:00100000:0.0:1788463293.340510:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395501824 00000100:00100000:0.0:1788463293.340578:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:0.0:1788463293.340593:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+47:10412:x1875339395501824:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:0.0:1788463293.341576:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+48:10412:x1875339395501824:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 975us (1212us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788463293.341590:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:3.0:1788463293.388245:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463293.388417:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395502080 00000100:00100000:0.0:1788463293.388432:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395502080 00000100:00100000:0.0:1788463293.388513:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:0.0:1788463293.388524:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+48:10415:x1875339395502080:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463293.388552:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463293.388574:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35e35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de54 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.388666:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35e3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.388681:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35e3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.388744:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35e3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.388779:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.388787:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.388794:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.388919:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35e4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.388928:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.388935:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35e4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463293.388946:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788463293.389075:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35e3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389083:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35e3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389090:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35e3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389096:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463293.389101:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35e3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389119:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35e3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389133:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:0.0:1788463293.389136:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463293.389142:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35e3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389149:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35e3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389169:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389175:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35e43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389181:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389187:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463293.389190:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389195:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35e43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389201:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5c519aa00) 00010000:00010000:0.0:1788463293.389204:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463293.389206:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35e43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389222:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389273:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee35e35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de54 expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389289:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35e4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de54 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.389297:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:0.0:1788463293.389300:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463293.389303:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f800, rc 0) 00000100:00100000:0.0:1788463293.389377:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:10415:x1875339395502080:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 854us (1142us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788463293.389384:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:2.0:1788463293.394815:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463293.394882:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463293.395185:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395502208 00000100:00100000:3.0:1788463293.395200:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395502208 00000100:00100000:3.0:1788463293.395280:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:3.0:1788463293.395293:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:10415:x1875339395502208:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:3.0:1788463293.395389:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.395409:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.395423:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.395456:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.395464:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.395473:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.395490:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463293.395496:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.395504:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.395518:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:3.0:1788463293.395522:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463293.395548:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.395555:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463293.395664:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:10415:x1875339395502208:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 374us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463293.395672:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:0.0:1788463293.396116:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395502336 00000100:00100000:0.0:1788463293.396124:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395502336 00000100:00100000:0.0:1788463293.396176:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:0.0:1788463293.396185:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:2354:x1875339395502336:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463293.396198:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463293.396217:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35e4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de54 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463293.396229:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:0.0:1788463293.396233:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463293.396259:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+49:2354:x1875339395502336:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 76us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463293.396276:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:2.0:1788463293.405244:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463293.405364:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395502592 00000100:00100000:1.0:1788463293.405378:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395502592 00000100:00100000:1.0:1788463293.405444:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:1.0:1788463293.405455:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+49:10415:x1875339395502592:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:1.0:1788463293.405844:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:10415:x1875339395502592:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 389us (610us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788463293.405853:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:2.0:1788463293.573111:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463293.573547:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395502848 00000100:00100000:0.0:1788463293.573565:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395502848 00000100:00100000:3.0:1788463293.573809:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 64 00000100:00100000:3.0:1788463293.573827:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:10433:x1875339395502848:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:3.0:1788463293.573869:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463293.573898:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de5b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.574066:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35e66 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.574088:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.574103:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35e66 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463293.574116:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788463293.574293:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de5b expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.574318:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35e66 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de5b expref: 52 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.574354:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:3.0:1788463293.574357:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788463293.574362:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0c00, rc 0) 00000100:00100000:3.0:1788463293.574512:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10433:x1875339395502848:12345-192.168.204.11@tcp:101:cat.0 Request processed in 690us (1427us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788463293.574521:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 64 00000100:00100000:2.0:1788463293.605032:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463293.605987:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395502976 00000100:00100000:1.0:1788463293.606003:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395502976 00000100:00100000:1.0:1788463293.606214:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 65 00000100:00100000:1.0:1788463293.606227:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10434:x1875339395502976:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463293.606256:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463293.606287:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de62 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.606414:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.606432:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.606445:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463293.606495:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788463293.606499:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463293.606516:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.606546:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee35e74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de62 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.606567:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de62 expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463293.606577:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:1.0:1788463293.606580:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463293.606584:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488800, rc 0) 00000100:00100000:1.0:1788463293.606681:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10434:x1875339395502976:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 457us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463293.606759:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 65 00000100:00100000:1.0:1788463293.617520:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463293.617747:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395503360 00000100:00100000:3.0:1788463293.617762:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395503360 00000100:00100000:3.0:1788463293.617826:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:3.0:1788463293.617840:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10434:x1875339395503360:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463293.618427:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10434:x1875339395503360:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 588us (919us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788463293.618436:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:2.0:1788463293.628805:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463293.628926:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395503488 00000100:00100000:3.0:1788463293.628938:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395503488 00000100:00100000:3.0:1788463293.629118:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:3.0:1788463293.629132:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10434:x1875339395503488:12345-192.168.204.11@tcp:103:lfs.0 00010000:00010000:3.0:1788463293.629152:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788463293.629181:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de46 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.629206:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35e66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de5b expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.629219:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35d16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de07 expref: 52 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.629261:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58600) 00010000:00010000:3.0:1788463293.629274:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463293.629384:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+51:10434:x1875339395503488:12345-192.168.204.11@tcp:103:lfs.0 Request processed in 255us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463293.629392:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:1.0:1788463293.632512:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463293.632622:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395503616 00000100:00100000:3.0:1788463293.632636:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395503616 00000100:00100000:3.0:1788463293.632840:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 66 00000100:00100000:3.0:1788463293.632853:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+51:10434:x1875339395503616:12345-192.168.204.11@tcp:58:lfs.0 00010000:00010000:3.0:1788463293.633205:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e82 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.633295:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463293.633310:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463293.633649:0:8864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463293.634866:0:8864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788463293.635172:0:8864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788463293.635462:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+51:10434:x1875339395503616:12345-192.168.204.11@tcp:58:lfs.0 Request processed in 2593us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463293.635479:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 66 00000100:00100000:1.0:1788463293.660291:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463293.661051:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395503744 00000100:00100000:3.0:1788463293.661070:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395503744 00000100:00100000:2.0:1788463293.661299:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 67 00000100:00100000:2.0:1788463293.661319:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+51:10436:x1875339395503744:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463293.661359:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463293.661395:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35e89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de69 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661505:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35e90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661523:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661549:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661569:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661577:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661611:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661805:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661815:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661823:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463293.661863:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788463293.661867:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463293.661887:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661899:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661907:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661913:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35e90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661921:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661926:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cae00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463293.661930:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661945:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35e90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661959:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463293.661962:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463293.661968:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35e90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661974:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35e90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661988:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661994:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35e97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.661999:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.662004:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cb600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463293.662007:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.662013:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35e97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.662020:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463293.662023:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463293.662026:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35e97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.662184:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.662234:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee35e89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de69 expref: 53 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.662247:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de69 expref: 52 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463293.662255:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:2.0:1788463293.662257:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463293.662261:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8ca600, rc 0) 00000100:00100000:2.0:1788463293.662376:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10436:x1875339395503744:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1062us (2100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463293.662385:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 67 00000100:00100000:1.0:1788463293.989023:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408115712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463293.989118:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463293.989259:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408115712 00000100:00100000:2.0:1788463293.989269:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408115712 00000100:00100000:2.0:1788463293.989360:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788463293.989370:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408115712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463293.989410:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788463293.989492:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463294.000343:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408115712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10960us (11210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463294.000362:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788463294.000578:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408115712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463294.311233:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788463294.374512:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463294.374522:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463294.374571:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788463294.374578:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788463294.374760:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed66d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408115840:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788463294.374870:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481480 going to sleep for 11 seconds 00000100:00100000:3.0:1788463294.378660:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed66d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408115840:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788463294.382253:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.382597:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395503872 00000100:00100000:3.0:1788463294.382609:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395503872 00000100:00100000:3.0:1788463294.382723:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:3.0:1788463294.382737:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10447:x1875339395503872:12345-192.168.204.11@tcp:900:lhsmtool_posix.0 00000100:00080000:1.0:1788463294.382762:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463294.382842:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10447:x1875339395503872:12345-192.168.204.11@tcp:900:lhsmtool_posix.0 Request processed in 109us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463294.382852:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:3.0:1788463294.401625:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463294.402168:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395504000 00000100:00100000:1.0:1788463294.402179:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395504000 00000100:00100000:1.0:1788463294.402235:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 68 00000100:00100000:1.0:1788463294.402246:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10447:x1875339395504000:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788463294.402279:0:5816:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788463294.402395:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10447:x1875339395504000:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 150us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463294.402402:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 68 00000100:00100000:1.0:1788463294.422155:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463294.422329:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395504128 00000100:00100000:0.0:1788463294.422343:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395504128 00000100:00100000:0.0:1788463294.422409:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 69 00000100:00100000:0.0:1788463294.422420:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10447:x1875339395504128:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788463294.422519:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35ea5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422537:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422551:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422566:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35eac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422572:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35eac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422579:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35eac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422607:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422616:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422635:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463294.422709:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788463294.422714:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463294.422730:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422742:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35ea5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422748:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35ea5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422756:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422762:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463294.422776:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35ea5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422784:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35ea5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422796:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:0.0:1788463294.422799:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463294.422804:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35ea5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422857:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee35ea5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422885:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35eac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422891:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35eac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422897:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35eac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422901:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463294.422904:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35eac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422910:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35eac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422918:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9ba5c519aa00) 00010000:00010000:0.0:1788463294.422920:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463294.422923:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35eac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422928:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35eac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422946:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422953:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422958:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422970:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463294.422972:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422979:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422987:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:0.0:1788463294.422989:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463294.422992:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.422999:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35eb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463294.423093:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10447:x1875339395504128:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 Request processed in 672us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463294.423183:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 69 00000100:00100000:1.0:1788463294.440876:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.441070:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395504384 00000100:00100000:3.0:1788463294.441087:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395504384 00000100:00100000:3.0:1788463294.441208:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 70 00000100:00100000:3.0:1788463294.441228:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10447:x1875339395504384:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463294.441252:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463294.441276:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35eba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de70 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441416:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35ec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441434:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441457:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463294.441470:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788463294.441589:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441596:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441602:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441607:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463294.441611:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441619:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441632:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:3.0:1788463294.441636:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463294.441641:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35ec1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441648:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35ec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441736:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35eba lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de70 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441758:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:3.0:1788463294.441760:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463294.441774:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35eba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de70 expref: 54 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.441785:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1000, rc 0) 00000100:00100000:3.0:1788463294.441858:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10447:x1875339395504384:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 638us (997us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788463294.441867:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 70 00000100:00100000:1.0:1788463294.446560:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463294.446638:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395504512 00000100:00100000:0.0:1788463294.446651:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395504512 00000100:00100000:0.0:1788463294.446771:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 71 00000100:00100000:0.0:1788463294.446783:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10447:x1875339395504512:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788463294.446821:0:5818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788463294.446996:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10447:x1875339395504512:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 215us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463294.447005:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 71 00000100:00100000:2.0:1788463294.455918:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463294.456030:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395504768 00000100:00100000:1.0:1788463294.456044:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395504768 00000100:00100000:1.0:1788463294.456167:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00100000:1.0:1788463294.456183:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10447:x1875339395504768:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463294.456222:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463294.456227:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788463294.456263:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee35e7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de62 expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.456304:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:1.0:1788463294.456312:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463294.456333:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35ecf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de77 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463294.457945:0:8863:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788463294.458221:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35ed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.458559:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.458576:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.458753:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35ecf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de77 expref: 55 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.458786:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de77 expref: 54 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.458797:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:1.0:1788463294.458800:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463294.458805:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489000, rc 0) 00000100:00100000:1.0:1788463294.459151:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10447:x1875339395504768:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 2969us (3239us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788463294.459161:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00100000:1.0:1788463294.470147:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.470229:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395505024 00000100:00100000:3.0:1788463294.470240:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395505024 00000100:00100000:3.0:1788463294.470305:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 73 00000100:00100000:3.0:1788463294.470317:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10447:x1875339395505024:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463294.470450:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463294.470489:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee35ed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de77 expref: 54 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470510:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:3.0:1788463294.470526:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463294.470555:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35ee4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470571:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35ee4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470581:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35ee4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470658:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35eeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xaa6d2a2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470667:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35eeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa6d2a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470705:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35eeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa6d2a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470803:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35ee4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470811:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35ee4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470818:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35ee4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470825:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463294.470830:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35ee4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470839:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35ee4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470848:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:3.0:1788463294.470852:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463294.470856:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35ee4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470862:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35ee4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470878:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35eeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa6d2a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470885:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35eeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa6d2a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470893:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35eeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa6d2a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470899:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463294.470902:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35eeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa6d2a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470908:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35eeb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaa6d2a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470916:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xaa6d2a2 (ffff9ba5c5b58100) 00010000:00010000:3.0:1788463294.470919:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463294.470922:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35eeb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaa6d2a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.470928:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35eeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaa6d2a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463294.471255:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10447:x1875339395505024:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 938us (1241us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463294.471264:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 73 00000100:00100000:2.0:1788463294.474985:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463294.475165:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395505152 00000100:00100000:0.0:1788463294.475179:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395505152 00000100:00100000:0.0:1788463294.475292:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 74 00000100:00100000:0.0:1788463294.475306:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10447:x1875339395505152:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463294.475334:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463294.475375:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ef2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de7e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.475423:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.475440:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.475456:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.475559:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee35ef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de7e expref: 55 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.475578:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de7e expref: 54 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.475587:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:0.0:1788463294.475590:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788463294.475593:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e200, rc 0) 00000100:00100000:0.0:1788463294.475735:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10447:x1875339395505152:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 431us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463294.475743:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 74 00000100:00100000:0.0:1788463294.479192:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463294.479278:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395505408 00000100:00100000:1.0:1788463294.479296:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395505408 00000100:00100000:1.0:1788463294.479480:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 75 00000100:00100000:1.0:1788463294.479492:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10447:x1875339395505408:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788463294.479610:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.479637:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.479654:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788463294.480152:0:8863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788463294.480163:0:8863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326090477721ns, next at 327090475574ns, rc = 0 00000004:00010000:1.0:1788463294.480257:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099782feb reply state 000000000105baed transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463294.480267:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463294.480412:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:10447:x1875339395505408:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 919us (1235us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788463294.480422:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 75 00010000:00010000:3.0:1788463294.483842:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.483877:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.483886:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.483893:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463294.483900:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.483909:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.483929:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:3.0:1788463294.483932:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788463294.483938:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.483945:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee35f00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463294.485897:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.485959:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395505536 00000100:00100000:3.0:1788463294.485973:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395505536 00000100:00100000:3.0:1788463294.486172:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:3.0:1788463294.486189:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10447:x1875339395505536:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463294.486241:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463294.486268:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35f07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de85 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.486361:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de85 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.486416:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de85 expref: 56 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.486443:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:3.0:1788463294.486447:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463294.486452:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0c00, rc 0) 00000100:00100000:3.0:1788463294.486535:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:10447:x1875339395505536:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 352us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463294.486543:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:1.0:1788463294.489661:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.489931:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395505664 00000100:00100000:3.0:1788463294.489945:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395505664 00000100:00100000:3.0:1788463294.490036:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:3.0:1788463294.490045:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875339395505664:12345-192.168.204.11@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788463294.490081:0:6665:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:3.0:1788463294.490111:0:6665:0:(genops.c:1385:class_connect()) connect: client c87dc105-ebf6-45f0-8943-2a25b33dd5b8, cookie 0xc3fe72277ee35f0e 00002000:00100000:3.0:1788463294.490124:0:6665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c87dc105-ebf6-45f0-8943-2a25b33dd5b8/ffff9ba5ebdea800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788463294.490135:0:6665:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788463294.490554:0:6665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788463294.490593:0:6665:0:(import.c:65:import_set_state_nolock()) ffff9ba5ebded800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463294.490775:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2353:x1875339395505664:12345-192.168.204.11@tcp:8:lhsmtool_posix.0 Request processed in 728us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463294.490784:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:0.0:1788463294.494011:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.494159:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395505792 00000100:00100000:3.0:1788463294.494175:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395505792 00000100:00100000:3.0:1788463294.494362:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:3.0:1788463294.494375:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:0:x1875339395505792:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788463294.494664:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788463294.554967:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1788463294.555077:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000100:00100000:3.0:1788463294.555158:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:0:x1875339395505792:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 60773us (61149us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788463294.555174:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:3.0:1788463294.559642:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.560122:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395506048 00000100:00100000:3.0:1788463294.560152:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395506048 00000100:00100000:3.0:1788463294.560241:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:3.0:1788463294.560252:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:10447:x1875339395506048:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788463294.564412:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:10447:x1875339395506048:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 4024us (4653us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788463294.564432:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:3.0:1788463294.569204:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463294.569790:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395506304 00000100:00100000:0.0:1788463294.569812:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395506304 00000100:00100000:0.0:1788463294.569974:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00100000:0.0:1788463294.569990:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:10447:x1875339395506304:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788463294.570190:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:10447:x1875339395506304:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 205us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463294.570199:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00100000:1.0:1788463294.579657:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.579856:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395506432 00000100:00100000:3.0:1788463294.579872:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395506432 00000100:00100000:3.0:1788463294.579967:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 78 00000100:00100000:3.0:1788463294.579981:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:10447:x1875339395506432:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463294.580009:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463294.580055:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35f15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de8c expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.580187:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.580209:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.580245:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463294.580326:0:8863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463294.580356:0:8863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.580395:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee35f15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de8c expref: 59 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.580419:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de8c expref: 58 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.580430:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:3.0:1788463294.580433:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788463294.580437:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1600, rc 0) 00000100:00100000:3.0:1788463294.580527:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+58:10447:x1875339395506432:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 549us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463294.580534:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 78 00000100:00100000:1.0:1788463294.594880:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463294.595026:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395506560 00000100:00100000:2.0:1788463294.595040:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395506560 00000100:00100000:2.0:1788463294.595126:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:2.0:1788463294.595141:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395506560:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463294.595165:0:8660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463294.595196:0:8660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003741194a/0xc3fe72277ee35f23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de93 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788463294.595237:0:8660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99c8be, blocks: 0x1 00010000:00010000:2.0:1788463294.595267:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1788463294.595273:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463294.595293:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003741194a/0xc3fe72277ee35f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de93 expref: 6 pid: 8660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.595320:0:8660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003741194a/0xc3fe72277ee35f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de93 expref: 6 pid: 8660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.595336:0:8660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cac00, rc 0) 00000100:00100000:2.0:1788463294.595659:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395506560:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 521us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463294.595668:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:3.0:1788463294.602754:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463294.602904:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395506816 00000100:00100000:2.0:1788463294.602921:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395506816 00000100:00100000:2.0:1788463294.603005:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 79 00000100:00100000:2.0:1788463294.603019:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+58:10447:x1875339395506816:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788463294.603209:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+58:10447:x1875339395506816:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 193us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463294.603217:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 79 00000100:00100000:0.0:1788463294.620773:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.623766:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395506944 00000100:00100000:3.0:1788463294.623792:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395506944 00000100:00100000:3.0:1788463294.623891:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:3.0:1788463294.623906:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:10447:x1875339395506944:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463294.623934:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463294.623964:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51de9a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.624043:0:6667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003741194a/0xc3fe72277ee35f23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de93 expref: 7 pid: 8660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.624056:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463294.624063:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463294.624071:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 7 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.624119:0:6667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003741194a/0xc3fe72277ee35f23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de93 expref: 7 pid: 8660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.624136:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003741194a/0xc3fe72277ee35f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de93 expref: 7 pid: 8660 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463294.624154:0:6667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6667:1875339408115968:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463294.624530:0:6667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c4f469c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463294.629544:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.629602:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395507072 00000100:00100000:3.0:1788463294.629620:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395507072 00010000:00010000:3.0:1788463294.629731:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003741194a/0xc3fe72277ee35f23 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de93 expref: 8 pid: 8660 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463294.629785:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:3.0:1788463294.629800:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c8993850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395507072:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463294.629851:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463294.629893:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003741194a/0xc3fe72277ee35f23 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de93 expref: 8 pid: 8660 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.629915:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003741194a/0xc3fe72277ee35f23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de93 expref: 8 pid: 8660 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.629950:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463294.629957:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463294.629970:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.629982:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.630063:0:8442:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 8 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463294.630081:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fec59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8442:1875339408116096:192.168.204.11@tcp:105: 00000100:00100000:3.0:1788463294.630196:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788463294.630561:0:6667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003741194a/0xc3fe72277ee35f23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de93 expref: 8 pid: 8660 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463294.630590:0:6667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6667:1875339408115968:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463294.630634:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 7 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.630647:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1000, rc 0) 00000100:00100000:0.0:1788463294.630728:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:10447:x1875339395506944:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 6824us (9973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463294.630739:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:0.0:1788463294.646153:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fec59500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8442:1875339408116096:192.168.204.11@tcp:105: 00010000:00010000:0.0:1788463294.646201:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463294.646280:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c8993850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395507072:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 16482us (16755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463294.646294:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:3.0:1788463294.646577:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463294.648415:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395507200 00000100:00100000:0.0:1788463294.648437:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395507200 00002000:00100000:0.0:1788463294.648524:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ba5fec5ad80 x1875339395507200/t0(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:430/0 lens 504/0 e 0 to 0 dl 1788463305 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463294.648537:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5fec5ad80 with x1875339395507200 ext(0->8) 00002000:00010000:0.0:1788463294.648545:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5fec5ad80 00000100:00100000:0.0:1788463294.649146:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:0.0:1788463294.649163:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395507200:12345-192.168.204.11@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788463294.650118:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395507200:12345-192.168.204.11@tcp:4:lhsmtool_posix.0 Request processed in 955us (3536us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788463294.650129:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00002000:00100000:0.0:1788463294.650145:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ba5fec5ad80 x1875339395507200/t4294967302(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:430/0 lens 504/448 e 0 to 0 dl 1788463305 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463294.650156:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5fec5ad80 with x1875339395507200 ext(0->8) 00002000:00010000:0.0:1788463294.650164:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5fec5ad80 00000100:00100000:1.0:1788463294.660397:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463294.660776:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395507328 00000100:00100000:0.0:1788463294.660791:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395507328 00000100:00100000:2.0:1788463294.661755:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 80 00000100:00100000:2.0:1788463294.661775:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+58:10447:x1875339395507328:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788463294.765036:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+58:10447:x1875339395507328:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 Request processed in 103244us (104632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463294.765052:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 80 00000001:00080000:0.0:1788463294.767365:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000004:00080000:0.0:1788463294.767388:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788463294.767593:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463294.767611:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408116224:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788463294.767705:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463294.767768:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408116224 00000100:00100000:2.0:1788463294.767775:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408116224 00000100:00100000:2.0:1788463294.767829:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463294.768000:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3276:x1875339408116224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788463294.768040:0:8660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788463294.768074:0:8660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a99c8bb, atime: 0x6a99c8bb, ctime: 0x6a99c8bb, blocks: 0xb 00010000:00010000:2.0:1788463294.768083:0:8660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003741194a/0xc3fe72277ee35f31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.768102:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1788463294.768107:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463294.768114:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003741194a/0xc3fe72277ee35f31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.768147:0:8660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003741194a/0xc3fe72277ee35f31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.768159:0:8660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003741194a/0xc3fe72277ee35f31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.768167:0:8660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003741194a/0xc3fe72277ee35f31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.768185:0:8660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463294.768893:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463294.768905:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003741194a/0xc3fe72277ee35f31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.768916:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cac00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463294.768928:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003741194a/0xc3fe72277ee35f31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.768939:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003741194a/0xc3fe72277ee35f31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.768959:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003741194a/0xc3fe72277ee35f31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.768966:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003741194a/0xc3fe72277ee35f31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.768986:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463294.768988:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463294.768989:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463294.769058:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408116224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1060us (1350us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788463294.769068:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788463294.769099:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788463294.769141:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5f795b480/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788463294.769148:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408116224:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788463294.769185:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.769215:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395507456 00000100:00100000:3.0:1788463294.769223:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395507456 00000100:00100000:3.0:1788463294.769261:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:3.0:1788463294.769270:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395507456:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 00000020:00080000:0.0:1788463294.770532:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ba5e0481840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788463294.770542:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c5c27100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5e04810c0 00000020:00080000:0.0:1788463294.770546:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c5c27700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5c9a71400 00000001:00080000:0.0:1788463294.770568:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1788463294.770573:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:0.0:1788463294.770644:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1788463294.771178:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788463294.771304:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788463294.771453:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408116352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788463294.771556:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463294.772620:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408116352 00000100:00100000:3.0:1788463294.772631:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408116352 00000100:00100000:3.0:1788463294.776265:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788463294.776290:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408116352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788463294.776590:0:6665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788463294.776596:0:6665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788463295 00002000:00010000:3.0:1788463294.776599:0:6665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788463294.776611:0:6665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788463294 -> 1788463295 00002000:00010000:3.0:1788463294.776614:0:6665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788463294.776975:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875339408116352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 693us (5416us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788463294.776986:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000004:00080000:1.0:1788463294.779341:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5ec229880/2, rc 0, transno 4294967303 00000100:00100000:1.0:1788463294.779358:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408116352:0@lo:2:osp-syn-0-0.0 00000040:00080000:2.0:1788463294.819873:0:11996:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463294.819894:0:11996:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463294.819948:0:11996:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788463294.819956:0:11996:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788463294.850516:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788463294.851015:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395507456:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 Request processed in 81732us (81818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463294.851035:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:2.0:1788463294.853454:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.854179:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395507712 00000100:00100000:3.0:1788463294.854191:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395507712 00000100:00100000:3.0:1788463294.854250:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 81 00000100:00100000:3.0:1788463294.854262:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:10447:x1875339395507712:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463294.854329:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463294.854357:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de8c expref: 13 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.854372:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:3.0:1788463294.854378:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463294.854407:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.854420:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.854430:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463294.854785:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cfa1b57 reply state 00000000b1c27d9b transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463294.854795:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463294.854891:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:10447:x1875339395507712:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 630us (1445us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788463294.854907:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 81 00000100:00100000:3.0:1788463294.857873:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00010000:00010000:3.0:1788463294.857907:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.857920:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.857928:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.857934:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463294.858072:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.858084:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.858103:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:3.0:1788463294.858107:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463294.858112:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.858120:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463294.858152:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395507840 00000100:00100000:3.0:1788463294.858161:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395507840 00000100:00100000:3.0:1788463294.858208:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:3.0:1788463294.858217:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395507840:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788463294.858423:0:6667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788463294.858427:0:6667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788463295 -> 1788463293 00002000:00010000:3.0:1788463294.858430:0:6667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788463291 00002000:00010000:3.0:1788463294.858432:0:6667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788463295 -> 1788463293 00002000:00010000:3.0:1788463294.858434:0:6667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788463294.858537:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395507840:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 319us (671us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788463294.858546:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:3.0:1788463294.860766:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463294.860812:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395508096 00000100:00100000:0.0:1788463294.860823:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395508096 00000100:00100000:0.0:1788463294.860883:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 82 00000100:00100000:0.0:1788463294.860893:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:10447:x1875339395508096:12345-192.168.204.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788463294.861865:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.861894:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de7e expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.861913:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.862126:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de7e expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.862144:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de7e expref: 13 pid: 5818 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463294.862163:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f795aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408116480:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463294.862300:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463294.866794:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.867155:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f795aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408116480:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463294.867187:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463294.867614:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395508224 00000100:00100000:2.0:1788463294.867622:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395508224 00010000:00010000:2.0:1788463294.867659:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de7e expref: 14 pid: 5818 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463294.868138:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:2.0:1788463294.868149:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:2355:x1875339395508224:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463294.868165:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463294.868172:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de7e expref: 14 pid: 5818 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.868186:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de7e expref: 14 pid: 5818 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.868209:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee35ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de7e expref: 14 pid: 5818 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.868230:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:2.0:1788463294.868235:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.868249:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.868257:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.868340:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463294.868399:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2355:x1875339395508224:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 252us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463294.868407:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 43 00010000:00010000:2.0:1788463294.869059:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.869071:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.869104:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.869112:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.869119:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.869124:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cb600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463294.869137:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.869144:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.869156:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:2.0:1788463294.869158:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788463294.869162:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.869169:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee35f3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463294.869274:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:10447:x1875339395508096:12345-192.168.204.11@tcp:55:lhsmtool_posix.0 Request processed in 8380us (8514us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788463294.869284:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 82 00000100:00100000:0.0:1788463294.873203:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463294.873237:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395508352 00000100:00100000:0.0:1788463294.873246:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395508352 00000100:00100000:0.0:1788463294.873299:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:0.0:1788463294.873308:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395508352:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788463294.873350:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.873371:0:6665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 7 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.873380:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463294.873385:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463294.873390:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.873424:0:6665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 7 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.873457:0:6665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 7 pid: 6667 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463294.873472:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6665:1875339408116608:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463294.873553:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec804840 going to sleep for 11 seconds 00000100:00100000:3.0:1788463294.884640:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6665:1875339408116608:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463294.884753:0:6665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463294.884755:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463294.884958:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395508480 00000100:00100000:2.0:1788463294.884965:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395508480 00010000:00010000:2.0:1788463294.885001:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 8 pid: 6667 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463294.885089:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:2.0:1788463294.885099:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2357:x1875339395508480:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463294.885113:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463294.885135:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 8 pid: 6667 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.885149:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 8 pid: 6667 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.885180:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee35f2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de9a expref: 8 pid: 6667 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.885193:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463294.885198:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463294.885203:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.885213:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463294.885238:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463294.885328:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2357:x1875339395508480:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 230us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463294.885336:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 44 00010000:00010000:3.0:1788463294.886265:0:6665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.886279:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.886310:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.886331:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.886340:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.886348:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463294.886354:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.886363:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.886379:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.886387:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee35f46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463294.886504:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395508352:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 Request processed in 13194us (13308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463294.886513:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:0.0:1788463294.889091:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463294.889156:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395508736 00000100:00100000:3.0:1788463294.889167:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395508736 00000100:00100000:3.0:1788463294.889226:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 83 00000100:00100000:3.0:1788463294.889250:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:10447:x1875339395508736:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788463294.889346:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.889366:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.889379:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.889654:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.889850:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35f07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de85 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.889861:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.889901:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de85 expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.889918:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35f07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de85 expref: 13 pid: 5817 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463294.889936:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fec5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408116736:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463294.890258:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463294.893854:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463294.893989:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395508864 00000100:00100000:0.0:1788463294.894002:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395508864 00010000:00010000:0.0:1788463294.894057:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35f07 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de85 expref: 14 pid: 5817 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463294.894107:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:0.0:1788463294.894117:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:2354:x1875339395508864:12345-192.168.204.11@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788463294.894121:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fec5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408116736:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463294.894133:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463294.894140:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35f07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de85 expref: 14 pid: 5817 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.894149:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.894152:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35f07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de85 expref: 14 pid: 5817 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.894178:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee35f07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de85 expref: 14 pid: 5817 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.894448:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:0.0:1788463294.894455:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.894469:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.894477:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.894505:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463294.894608:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2354:x1875339395508864:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 491us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463294.894617:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 45 00010000:00010000:3.0:1788463294.894708:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.894716:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463294.895001:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788463294.895182:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788463294.895228:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788463294.895343:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fec5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5818:1875339408116864:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788463294.895400:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463294.895426:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5c34d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463294.895515:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408116864 00000100:00100000:0.0:1788463294.895522:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408116864 00000100:00100000:0.0:1788463294.895571:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463294.895581:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1875339408116864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788463294.895676:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1875339408116864:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463294.895706:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463294.895750:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fec5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5818:1875339408116864:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788463294.896268:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788463294.896332:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec228380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5818:1875339408116992:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788463294.896363:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463294.896381:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec804240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463294.896399:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408116992 00000100:00100000:0.0:1788463294.896403:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408116992 00000100:00100000:0.0:1788463294.896433:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463294.896439:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1875339408116992:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788463294.896587:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5818:x1875339408116992:12345-0@lo:1000:mdt00_002.0 Request processed in 147us (222us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788463294.896601:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463294.896638:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec228380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5818:1875339408116992:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788463294.896682:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896717:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896724:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896730:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463294.896734:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896743:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896760:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:0.0:1788463294.896763:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463294.896768:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896774:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35f54 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896818:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e82 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896825:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e82 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896840:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e82 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896846:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463294.896848:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e82 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896854:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e82 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896862:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:0.0:1788463294.896864:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463294.896867:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e82 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896872:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35e82 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896895:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896911:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de69 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896919:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896944:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de69 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.896969:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de69 expref: 16 pid: 5817 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463294.896980:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec228a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408117120:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463294.897027:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec804240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463294.900865:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463294.900958:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec228a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408117120:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463294.900987:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463294.901043:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395508992 00000100:00100000:3.0:1788463294.901050:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395508992 00010000:00010000:3.0:1788463294.901083:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de69 expref: 17 pid: 5817 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463294.901119:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:3.0:1788463294.901127:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:2354:x1875339395508992:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463294.901143:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463294.901150:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de69 expref: 17 pid: 5817 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.901163:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de69 expref: 17 pid: 5817 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.901187:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee35e9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51de69 expref: 17 pid: 5817 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.901216:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:3.0:1788463294.901222:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.901231:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.901239:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463294.901266:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463294.901330:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:2354:x1875339395508992:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 202us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463294.901337:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 46 00010000:00010000:0.0:1788463294.901436:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901444:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901457:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901464:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901471:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901477:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463294.901482:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901490:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901509:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:0.0:1788463294.901511:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463294.901515:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901522:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee35f5b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901534:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901541:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901546:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901551:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463294.901554:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901560:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901568:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58200) 00010000:00010000:0.0:1788463294.901570:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788463294.901572:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463294.901578:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463294.901872:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:10447:x1875339395508736:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 12623us (12800us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788463294.901881:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 83 00000020:00080000:0.0:1788463294.901885:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788463294.902247:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463294.902254:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463294.902278:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788463294.902285:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788463294.907086:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463294.907199:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395509248 00000100:00100000:1.0:1788463294.907209:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395509248 00000100:00100000:1.0:1788463294.907281:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:1.0:1788463294.907291:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:10447:x1875339395509248:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788463294.908119:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788463294.908245:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788463294.908301:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908322:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908334:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908342:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908349:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908355:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908379:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788463294.908486:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:10447:x1875339395509248:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 1194us (1417us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788463294.908502:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00000020:00080000:1.0:1788463294.908508:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788463294.908549:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463294.908556:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908563:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463294.908569:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908578:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908593:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ba5d9430d00) 00010000:00010000:1.0:1788463294.908596:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788463294.908602:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908608:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee35f62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463294.908628:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463294.908630:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463294.908632:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463295.016800:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408117248:0@lo:400:kworker.0 00000100:00100000:2.0:1788463295.016960:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463295.017085:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408117248 00000100:00100000:0.0:1788463295.017094:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408117248 00000100:00100000:2.0:1788463295.017131:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408117504:0@lo:400:kworker.0 00000100:00100000:0.0:1788463295.017139:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788463295.017148:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408117248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463295.017160:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463295.017180:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463295.017186:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408117376:0@lo:400:kworker.0 00000100:00100000:1.0:1788463295.017240:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408117632:0@lo:400:kworker.0 00000100:00100000:3.0:1788463295.017276:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408117248:0@lo:400:kworker.0 00000100:00100000:2.0:1788463295.017285:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463295.018564:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408117248:12345-0@lo:400:kworker.0 Request processed in 1408us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463295.018576:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788463295.018811:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408117504 00000100:00100000:3.0:1788463295.018820:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408117504 00000100:00100000:3.0:1788463295.018943:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408117376 00000100:00100000:3.0:1788463295.018948:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408117376 00000100:00100000:3.0:1788463295.018970:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788463295.018989:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408117504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463295.019088:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408117504:12345-0@lo:400:kworker.0 Request processed in 110us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463295.019113:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788463295.019127:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788463295.019133:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408117376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463295.019162:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408117376:12345-0@lo:400:kworker.0 Request processed in 30us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463295.019167:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788463295.019660:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408117376:0@lo:400:kworker.0 00000100:00100000:3.0:1788463295.019731:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408117504:0@lo:400:kworker.0 00000100:00080000:0.0:1788463295.020015:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463295.020178:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463295.020498:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408117632 00000100:00100000:0.0:1788463295.020506:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408117632 00000100:00100000:0.0:1788463295.020658:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788463295.020711:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408117632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463295.020779:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408117632:12345-0@lo:400:kworker.0 Request processed in 99us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463295.020786:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1788463295.021120:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463295.021153:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408117632:0@lo:400:kworker.0 00010000:00010000:1.0:1788463295.333067:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463295.527393:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408117760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463295.527504:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463295.527709:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408117760 00000100:00100000:0.0:1788463295.527721:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408117760 00000100:00100000:0.0:1788463295.527788:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788463295.527798:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408117760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463295.527839:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463295.527898:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408117760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463295.527914:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788463295.528091:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408117760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463296.201810:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463296.201864:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463296.201905:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463296.201933:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463296.201966:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463296.202017:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395509376 00000100:00100000:3.0:1788463296.202032:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395509376 00000100:00100000:3.0:1788463296.202101:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 292 00000100:00100000:3.0:1788463296.202112:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395509376:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463296.202199:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395509376:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463296.202208:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 292 00000100:00100000:3.0:1788463296.202249:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395509760 00000100:00100000:3.0:1788463296.202252:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395509760 00000100:00100000:3.0:1788463296.202308:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395509632 00000100:00100000:3.0:1788463296.202312:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395509632 00000100:00100000:3.0:1788463296.202339:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 75 00000100:00100000:3.0:1788463296.202346:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c845e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395509760:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463296.202378:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c845e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395509760:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 33us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463296.202384:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 75 00000100:00100000:3.0:1788463296.202583:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:3.0:1788463296.202592:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395509632:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463296.202622:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395509632:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 31us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463296.202628:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:3.0:1788463296.202668:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395509504 00000100:00100000:3.0:1788463296.202673:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395509504 00000100:00100000:3.0:1788463296.202732:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395509888 00000100:00100000:3.0:1788463296.202735:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395509888 00000100:00100000:3.0:1788463296.202757:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 144 00000100:00100000:3.0:1788463296.202763:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:2354:x1875339395509504:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463296.202800:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:2354:x1875339395509504:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 36us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463296.202806:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 144 00000100:00100000:3.0:1788463296.202818:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 145 00000100:00100000:3.0:1788463296.202824:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395509888:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463296.202846:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395509888:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 23us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463296.202864:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 145 00000100:00080000:3.0:1788463296.202886:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463296.202891:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463296.202893:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788463296.357276:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788463296.652167:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000040:00080000:3.0:1788463296.711001:0:12048:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463296.711010:0:12048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463296.711043:0:12048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788463296.711049:0:12048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788463296.866653:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463296.866762:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395510144 00000100:00100000:3.0:1788463296.866773:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395510144 00000100:00100000:3.0:1788463296.866837:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 84 00000100:00100000:3.0:1788463296.866849:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:10466:x1875339395510144:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463296.866873:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463296.866895:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35f69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dea1 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.867123:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35f70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.867140:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35f70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.867155:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35f70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463296.867167:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788463296.867299:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35f69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea1 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.867333:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35f70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea1 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.867341:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:3.0:1788463296.867344:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788463296.867347:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0200, rc 0) 00000100:00100000:3.0:1788463296.867448:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:10466:x1875339395510144:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 601us (805us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788463296.867455:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 84 00000100:00100000:2.0:1788463296.871836:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463296.872060:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395510272 00000100:00100000:3.0:1788463296.872071:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395510272 00000100:00100000:3.0:1788463296.872135:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 85 00000100:00100000:3.0:1788463296.872148:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:10466:x1875339395510272:12345-192.168.204.11@tcp:34:lfs.0 00010000:00010000:3.0:1788463296.872245:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35f7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872262:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35f7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872274:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35f7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872290:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872297:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872316:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872568:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872578:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872586:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463296.872844:0:8863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872864:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35f7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872871:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35f7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872878:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35f7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872884:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463296.872890:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35f7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872899:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35f7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872914:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:3.0:1788463296.872922:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463296.872928:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35f7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.872935:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35f7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873265:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873273:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873280:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873285:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463296.873288:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873294:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873303:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5c5b58c00) 00010000:00010000:3.0:1788463296.873305:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463296.873308:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873313:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873327:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873340:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873345:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873350:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463296.873353:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873359:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873366:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58100) 00010000:00010000:3.0:1788463296.873369:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463296.873371:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.873377:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463296.873510:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:10466:x1875339395510272:12345-192.168.204.11@tcp:34:lfs.0 Request processed in 1362us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463296.873519:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 85 00000100:00100000:2.0:1788463296.975171:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463296.975482:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395510528 00000100:00100000:3.0:1788463296.975496:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395510528 00000100:00100000:3.0:1788463296.975575:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00100000:3.0:1788463296.975588:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:10469:x1875339395510528:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463296.975613:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463296.975661:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dea8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.975791:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.975808:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.975822:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.975840:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.975847:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.975855:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.977568:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.977594:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.977606:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463296.977622:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788463296.978565:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.978600:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.978609:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.978615:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463296.978622:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.978907:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.978927:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:3.0:1788463296.978930:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463296.978936:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979112:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979130:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979139:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979146:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979151:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463296.979161:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979167:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979176:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5c5b58100) 00010000:00010000:3.0:1788463296.979179:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463296.979182:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979189:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979272:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35f93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea8 expref: 22 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979288:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea8 expref: 21 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.979295:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:3.0:1788463296.979298:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463296.979300:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0800, rc 0) 00000100:00100000:3.0:1788463296.979479:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:10469:x1875339395510528:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 3890us (4319us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788463296.979490:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00100000:2.0:1788463296.987519:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463296.987613:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395510656 00000100:00100000:3.0:1788463296.988064:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395510656 00000100:00100000:3.0:1788463296.988126:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 87 00000100:00100000:3.0:1788463296.988136:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:10469:x1875339395510656:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:3.0:1788463296.988220:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.988238:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.988249:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.988279:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.988286:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.988293:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.988299:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463296.988304:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.988312:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.988323:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:3.0:1788463296.988326:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463296.988331:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463296.988337:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463296.988456:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:10469:x1875339395510656:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 321us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463296.988465:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 87 00000100:00100000:3.0:1788463296.991259:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463296.991300:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395510912 00000100:00100000:3.0:1788463296.991311:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395510912 00000100:00100000:3.0:1788463296.991443:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:3.0:1788463296.991455:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05a4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:10469:x1875339395510912:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463296.991933:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05a4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:10469:x1875339395510912:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 478us (683us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788463296.991942:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:2.0:1788463297.032212:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.032303:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395511168 00000100:00100000:3.0:1788463297.032313:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395511168 00000100:00100000:3.0:1788463297.032374:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 88 00000100:00100000:3.0:1788463297.032385:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:9988:x1875339395511168:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:3.0:1788463297.032416:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463297.032462:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fbd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51deaf expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.032807:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.032829:0:8863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea8 expref: 23 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.032840:0:8863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.032914:0:8863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea8 expref: 23 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.032932:0:8863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea8 expref: 23 pid: 5818 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463297.032964:0:8863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fec5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408117888:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463297.033115:0:8863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec396cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463297.039312:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463297.039516:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395511296 00000100:00100000:0.0:1788463297.039530:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395511296 00010000:00010000:0.0:1788463297.039648:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea8 expref: 24 pid: 5818 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463297.039738:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:1.0:1788463297.039755:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:2354:x1875339395511296:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463297.039776:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463297.039788:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea8 expref: 24 pid: 5818 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.039805:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea8 expref: 24 pid: 5818 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.039834:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:1.0:1788463297.039841:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.039855:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.039865:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.039893:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea8 expref: 24 pid: 5818 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463297.039920:0:8863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fec5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408117888:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463297.039979:0:8863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.039985:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463297.039990:0:8863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.039996:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463297.040026:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:2.0:1788463297.040076:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:2354:x1875339395511296:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 325us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463297.040085:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 47 00010000:00010000:3.0:1788463297.040255:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee35fbd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deaf expref: 24 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.040272:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deaf expref: 23 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.040300:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:3.0:1788463297.040302:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788463297.040304:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0600, rc 0) 00000100:00100000:3.0:1788463297.040330:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:9988:x1875339395511168:12345-192.168.204.11@tcp:101:bash.0 Request processed in 7948us (8137us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788463297.040338:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 88 00000100:00100000:1.0:1788463297.044192:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.044274:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395511552 00000100:00100000:3.0:1788463297.044286:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395511552 00000100:00100000:3.0:1788463297.044357:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 89 00000100:00100000:3.0:1788463297.044369:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:9988:x1875339395511552:12345-192.168.204.11@tcp:36:bash.0 00010000:00010000:3.0:1788463297.044745:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.044763:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.044776:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463297.044833:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788463297.044859:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8dad4fb reply state 00000000f1786c40 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463297.044869:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788463297.044915:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788463297.045038:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:9988:x1875339395511552:12345-192.168.204.11@tcp:36:bash.0 Request processed in 669us (856us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788463297.045046:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 89 00000020:00080000:3.0:1788463297.045060:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788463297.047648:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.047671:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.047680:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.047708:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463297.047714:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.047723:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.047749:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:3.0:1788463297.047752:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463297.047757:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.047764:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463297.048317:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463297.048929:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395511680 00000100:00100000:0.0:1788463297.048945:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395511680 00000100:00100000:0.0:1788463297.049048:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 90 00000100:00100000:0.0:1788463297.049063:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:9988:x1875339395511680:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:0.0:1788463297.049101:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463297.049125:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35fd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51deb6 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.049194:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35fd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deb6 expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.049209:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35fd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deb6 expref: 27 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.049231:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:0.0:1788463297.049234:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463297.049237:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e600, rc 0) 00000100:00100000:0.0:1788463297.049328:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:9988:x1875339395511680:12345-192.168.204.11@tcp:101:bash.0 Request processed in 268us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.049336:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 90 00000100:00100000:0.0:1788463297.053365:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.053476:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395511808 00000100:00100000:3.0:1788463297.053490:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395511808 00000100:00100000:3.0:1788463297.053560:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:3.0:1788463297.053571:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:9988:x1875339395511808:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:3.0:1788463297.053593:0:8660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463297.053621:0:8660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000031d9a42/0xc3fe72277ee35fe0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51debd expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463297.053672:0:8660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a99c8bd, atime: 0x6a99c8bb, ctime: 0x6a99c8bd, blocks: 0xb 00010000:00010000:3.0:1788463297.053728:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1788463297.053734:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463297.053744:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000031d9a42/0xc3fe72277ee35fe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51debd expref: 7 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.053766:0:8660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000031d9a42/0xc3fe72277ee35fe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51debd expref: 7 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.053783:0:8660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1e00, rc 0) 00000100:00100000:3.0:1788463297.054077:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:9988:x1875339395511808:12345-192.168.204.11@tcp:101:bash.0 Request processed in 506us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463297.054085:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:2.0:1788463297.058545:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.058650:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395511936 00000100:00100000:3.0:1788463297.058664:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395511936 00002000:00010000:3.0:1788463297.058744:0:6671:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788463297.058751:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5c2e2dc00 with x1875339395511936 ext(0->18446744073709551615) 00002000:00010000:3.0:1788463297.058766:0:6671:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5c2e2dc00. 00000100:00100000:3.0:1788463297.058796:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:3.0:1788463297.058807:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395511936:12345-192.168.204.11@tcp:10:bash.0 00002000:00010000:3.0:1788463297.059152:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788463297.059156:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788463293 -> 1788463297 00002000:00010000:3.0:1788463297.059159:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788463291 -> 1788463291 00002000:00010000:3.0:1788463297.059162:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788463293 -> 1788463297 00002000:00010000:3.0:1788463297.059180:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788463297.059253:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395511936:12345-192.168.204.11@tcp:10:bash.0 Request processed in 447us (718us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788463297.059262:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00002000:00010000:3.0:1788463297.059266:0:6671:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788463297.059268:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5c2e2dc00 with x1875339395511936 ext(0->18446744073709551615) 00002000:00010000:3.0:1788463297.059273:0:6671:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5c2e2dc00. 00000100:00100000:2.0:1788463297.149900:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.150027:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395512064 00000100:00100000:3.0:1788463297.150043:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395512064 00000100:00100000:3.0:1788463297.150113:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 91 00000100:00100000:3.0:1788463297.150124:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:10483:x1875339395512064:12345-192.168.204.11@tcp:34:lfs.0 00010000:00010000:3.0:1788463297.150233:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fe7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.150253:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.150267:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.150283:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.150290:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.150296:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.150605:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.150637:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.150646:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463297.151294:0:8863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151311:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fe7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151318:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fe7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151325:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151331:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.151335:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fe7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151343:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fe7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151365:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463297.151368:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463297.151373:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fe7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151379:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee35fe7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151397:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151404:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151409:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151415:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.151418:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151425:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151433:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5c5b58d00) 00010000:00010000:2.0:1788463297.151435:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463297.151438:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151444:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee35fee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151474:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151481:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151487:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151493:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.151496:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151502:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151511:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:2.0:1788463297.151514:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463297.151517:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.151524:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee35ff5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.151834:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:10483:x1875339395512064:12345-192.168.204.11@tcp:34:lfs.0 Request processed in 1705us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463297.151844:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 91 00000100:00100000:1.0:1788463297.197920:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.198097:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395512320 00000100:00100000:2.0:1788463297.198111:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395512320 00000100:00100000:2.0:1788463297.198193:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 92 00000100:00100000:2.0:1788463297.198226:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:10486:x1875339395512320:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463297.198258:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463297.198285:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35ffc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dec4 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.198385:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36003 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.198402:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.198415:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.198431:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3600a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.198438:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3600a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.198445:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3600a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.198807:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.198816:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.198822:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463297.198843:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788463297.199166:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199175:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36003 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199181:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199187:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cb600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.199191:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199199:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36003 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199212:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463297.199215:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463297.199221:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36003 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199227:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36003 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199241:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3600a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199246:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3600a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199262:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3600a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199266:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cac00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.199270:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3600a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199279:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3600a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199288:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5d0c1eb00) 00010000:00010000:2.0:1788463297.199290:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463297.199293:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3600a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199299:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3600a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199352:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee35ffc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dec4 expref: 30 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199367:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dec4 expref: 29 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.199373:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:2.0:1788463297.199375:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788463297.199377:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8ca600, rc 0) 00000100:00100000:2.0:1788463297.199561:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:10486:x1875339395512320:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1337us (1664us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788463297.199579:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 92 00000100:00100000:3.0:1788463297.204515:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.204596:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395512448 00000100:00100000:2.0:1788463297.204611:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395512448 00000100:00100000:2.0:1788463297.204736:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 93 00000100:00100000:2.0:1788463297.204750:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:10486:x1875339395512448:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:2.0:1788463297.204854:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.204878:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deaf expref: 29 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.204890:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.204954:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deaf expref: 29 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.204981:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deaf expref: 29 pid: 8863 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.204999:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408118016:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463297.205515:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c85286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463297.209519:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408118016:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463297.209563:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463297.210382:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.210462:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395512704 00000100:00100000:2.0:1788463297.210488:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395512704 00000100:00100000:2.0:1788463297.210557:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:2.0:1788463297.210568:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:5594:x1875339395512704:12345-192.168.204.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788463297.211026:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:5594:x1875339395512704:12345-192.168.204.11@tcp:35:ldlm_bl.0 Request processed in 459us (649us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788463297.211035:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:3.0:1788463297.216105:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463297.216244:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395512832 00000100:00100000:0.0:1788463297.216258:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395512832 00010000:00010000:0.0:1788463297.216319:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deaf expref: 31 pid: 8863 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463297.216369:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:0.0:1788463297.216380:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:2354:x1875339395512832:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463297.216399:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463297.216408:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deaf expref: 31 pid: 8863 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.216421:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deaf expref: 31 pid: 8863 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.216449:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee35fc4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deaf expref: 31 pid: 8863 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.216470:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:0.0:1788463297.216477:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.216489:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.216498:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.216546:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463297.216653:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:2354:x1875339395512832:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 273us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.216662:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 48 00010000:00010000:1.0:1788463297.216844:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.216853:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.216894:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.216909:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.216915:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.216922:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703aa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463297.216928:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.216937:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.216949:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:1.0:1788463297.216951:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463297.216956:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.216963:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3601f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463297.217020:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:10486:x1875339395512448:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 12272us (12517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463297.217030:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 93 00000100:00100000:1.0:1788463297.220333:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.220432:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395513088 00000100:00100000:2.0:1788463297.220445:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395513088 00000100:00100000:2.0:1788463297.220517:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:2.0:1788463297.220529:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:10486:x1875339395513088:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:2.0:1788463297.221208:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:10486:x1875339395513088:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 679us (884us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788463297.221216:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:3.0:1788463297.308832:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.309003:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395513344 00000100:00100000:2.0:1788463297.309017:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395513344 00000100:00100000:2.0:1788463297.309087:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 94 00000100:00100000:2.0:1788463297.309096:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:10497:x1875339395513344:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:2.0:1788463297.309121:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463297.309149:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36026 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51decb expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.309257:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3602d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.309276:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3602d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.309288:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3602d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.309322:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36034 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.309328:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.309334:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.309884:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee3603b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.309897:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee3603b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.309904:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee3603b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463297.309918:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788463297.310107:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3602d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310116:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3602d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310123:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3602d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310128:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703ba00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.310134:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3602d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310157:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3602d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310171:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463297.310174:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463297.310180:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3602d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310187:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3602d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310210:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310216:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36034 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310222:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310227:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703a000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.310230:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310237:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36034 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310244:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5d0c1eb00) 00010000:00010000:2.0:1788463297.310247:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463297.310250:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36034 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310265:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36034 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310319:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36026 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51decb expref: 33 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310332:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee3603b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51decb expref: 32 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.310340:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:2.0:1788463297.310342:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463297.310345:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e703a600, rc 0) 00000100:00100000:2.0:1788463297.310497:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:10497:x1875339395513344:12345-192.168.204.11@tcp:101:cat.0 Request processed in 1401us (1684us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788463297.310506:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 94 00000100:00100000:0.0:1788463297.316811:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.316910:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395513600 00000100:00100000:2.0:1788463297.316927:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395513600 00000100:00100000:2.0:1788463297.317013:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:2.0:1788463297.317025:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:10497:x1875339395513600:12345-192.168.204.11@tcp:35:cat.0 00000100:00100000:2.0:1788463297.317351:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:10497:x1875339395513600:12345-192.168.204.11@tcp:35:cat.0 Request processed in 328us (557us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788463297.317360:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:1.0:1788463297.345142:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.345233:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395513856 00000100:00100000:2.0:1788463297.345244:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395513856 00000100:00100000:2.0:1788463297.345301:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 95 00000100:00100000:2.0:1788463297.345311:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:10498:x1875339395513856:12345-192.168.204.11@tcp:36:rm.0 00010000:00010000:2.0:1788463297.345390:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788463297.345420:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee3603b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51decb expref: 33 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.345444:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dec4 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.345458:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee35fd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deb6 expref: 31 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.345472:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5c5b58c00) 00010000:00010000:2.0:1788463297.345487:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463297.345521:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36049 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.345539:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36049 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.345551:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36049 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.345567:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.345575:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.345582:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346003:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee36057 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346012:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee36057 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346019:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee36057 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463297.346642:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788463297.346655:0:5816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328956970132ns, next at 329956966019ns, rc = 0 00010000:00010000:2.0:1788463297.346764:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346775:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346785:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346795:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346802:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346809:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346838:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463297.346864:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee36057 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346878:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee36057 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346887:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee36057 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346893:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703ba00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.346899:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee36057 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346908:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee36057 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346920:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5d0c1e200) 00010000:00010000:2.0:1788463297.346923:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788463297.346929:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee36057 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346936:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee36057 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346959:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36049 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346966:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36049 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346972:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36049 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346977:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703b400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.346985:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36049 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.346992:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36049 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.347001:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463297.347003:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463297.347006:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36049 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.347012:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36049 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463297.347022:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000277e0c34 reply state 000000009db5a9dd transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.347031:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463297.347118:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:10498:x1875339395513856:12345-192.168.204.11@tcp:36:rm.0 Request processed in 1807us (1986us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788463297.347128:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 95 00010000:00010000:3.0:1788463297.347845:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463297.347856:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.347863:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703aa00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463297.347867:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.347876:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.347890:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ba5d0c1e200) 00010000:00010000:3.0:1788463297.347893:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788463297.347896:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.347902:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3605e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.347924:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463297.347926:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463297.347940:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463297.349816:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.349839:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.349848:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.349855:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703a000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463297.349861:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.349872:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.349897:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5d0c1eb00) 00010000:00010000:3.0:1788463297.349902:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463297.349909:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.349917:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36050 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.381223:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463297.428243:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.428346:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395514112 00000100:00100000:2.0:1788463297.428358:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395514112 00000100:00100000:2.0:1788463297.428428:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 96 00000100:00100000:2.0:1788463297.428442:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:10504:x1875339395514112:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1788463297.428470:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463297.428493:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36065 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ded2 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.428660:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3606c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.428751:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3606c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.428768:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3606c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.428787:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.428794:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.428801:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788463297.429610:0:8864:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788463297.430401:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.430417:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.430433:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.430478:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3606c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.430486:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3606c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.430494:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3606c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.430510:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703ba00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.430515:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3606c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.430524:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3606c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.430539:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463297.430542:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463297.430547:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3606c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.430554:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee3606c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463297.430570:0:8864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b05d64b0 reply state 00000000ffeb60e1 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.430581:0:8864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788463297.431644:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36065 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded2 expref: 34 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.431755:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded2 expref: 33 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.431768:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463297.431771:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463297.431774:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e703a000, rc 0) 00000100:00100000:2.0:1788463297.431951:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:10504:x1875339395514112:12345-192.168.204.11@tcp:101:bash.0 Request processed in 3500us (3707us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788463297.432040:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 96 00010000:00010000:3.0:1788463297.437239:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.437259:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.437268:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.437295:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703a600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463297.437301:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.437309:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.437327:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5d0c1e000) 00010000:00010000:3.0:1788463297.437330:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463297.437335:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.437342:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36073 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463297.439139:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.439232:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395514240 00000100:00100000:3.0:1788463297.439243:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395514240 00000100:00100000:3.0:1788463297.439304:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:3.0:1788463297.439316:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2355:x1875339395514240:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:3.0:1788463297.439334:0:6665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463297.439363:0:6665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5563c28/0xc3fe72277ee36088 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51ded9 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463297.439397:0:6665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788463297.439421:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1788463297.439426:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463297.439439:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5563c28/0xc3fe72277ee36088 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded9 expref: 6 pid: 6665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.439491:0:6665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5563c28/0xc3fe72277ee36088 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded9 expref: 6 pid: 6665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.439509:0:6665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0c00, rc 0) 00000100:00100000:3.0:1788463297.439600:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395514240:12345-192.168.204.11@tcp:101:bash.0 Request processed in 286us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463297.439608:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:0.0:1788463297.445789:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463297.445893:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395514368 00000100:00100000:1.0:1788463297.445936:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395514368 00000100:00100000:1.0:1788463297.446031:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:1.0:1788463297.446043:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:10504:x1875339395514368:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:1.0:1788463297.446071:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463297.446096:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dee0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.446134:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5563c28/0xc3fe72277ee36088 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded9 expref: 7 pid: 6665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.446144:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463297.446148:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463297.446154:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.446192:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5563c28/0xc3fe72277ee36088 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded9 expref: 7 pid: 6665 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.446210:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5563c28/0xc3fe72277ee36088 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded9 expref: 7 pid: 6665 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463297.446224:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6668:1875339408118144:192.168.204.11@tcp:104: 00000100:00100000:1.0:1788463297.446342:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463297.451379:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.451498:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395514496 00000100:00100000:2.0:1788463297.451511:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395514496 00010000:00010000:2.0:1788463297.451575:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5563c28/0xc3fe72277ee36088 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded9 expref: 8 pid: 6665 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.451644:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:2.0:1788463297.451657:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c8993050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395514496:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463297.451732:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463297.451771:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5563c28/0xc3fe72277ee36088 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded9 expref: 8 pid: 6665 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.451790:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5563c28/0xc3fe72277ee36088 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded9 expref: 8 pid: 6665 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.451827:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463297.451833:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463297.451846:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.451860:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.451914:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.451977:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5802:1875339408118272:192.168.204.11@tcp:105: 00000100:00100000:2.0:1788463297.452059:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528f00 going to sleep for 11 seconds 00010000:00010000:1.0:1788463297.453114:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5563c28/0xc3fe72277ee36088 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded9 expref: 8 pid: 6665 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463297.453161:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6668:1875339408118144:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463297.453199:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.453213:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488800, rc 0) 00000100:00100000:1.0:1788463297.453282:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:10504:x1875339395514368:12345-192.168.204.11@tcp:101:bash.0 Request processed in 7240us (7514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463297.453293:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:2.0:1788463297.458276:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5802:1875339408118272:192.168.204.11@tcp:105: 00010000:00010000:2.0:1788463297.458315:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463297.458391:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c8993050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395514496:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 6736us (7023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463297.458404:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:0.0:1788463297.464459:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.464596:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395514752 00000100:00100000:2.0:1788463297.464610:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395514752 00000100:00100000:2.0:1788463297.464730:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:2.0:1788463297.464743:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:10504:x1875339395514752:12345-192.168.204.11@tcp:35:bash.0 00000100:00100000:2.0:1788463297.465209:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:10504:x1875339395514752:12345-192.168.204.11@tcp:35:bash.0 Request processed in 465us (761us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788463297.465218:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:3.0:1788463297.690462:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463297.690849:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395514880 00000100:00100000:0.0:1788463297.690869:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395514880 00000100:00100000:0.0:1788463297.690979:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 97 00000100:00100000:0.0:1788463297.690992:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:10520:x1875339395514880:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463297.691062:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463297.691092:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dee7 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.691221:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee3609d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.691239:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee3609d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.691253:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee3609d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463297.691297:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788463297.691302:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463297.691325:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee3609d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.691357:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee7 expref: 36 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.691409:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee3609d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee7 expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.691420:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:0.0:1788463297.691423:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463297.691428:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f000, rc 0) 00000100:00100000:0.0:1788463297.691529:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:10520:x1875339395514880:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 540us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.691537:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 97 00000100:00100000:0.0:1788463297.696848:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463297.696999:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395515136 00000100:00100000:1.0:1788463297.697013:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395515136 00000100:00100000:1.0:1788463297.697095:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 98 00000100:00100000:1.0:1788463297.697107:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:10520:x1875339395515136:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463297.697133:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463297.697158:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee360a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51deee expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.697298:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee360ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.697314:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee360ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.697330:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee360ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463297.697343:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788463297.697566:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee360a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deee expref: 38 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.697595:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee360ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deee expref: 37 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.697605:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:1.0:1788463297.697609:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463297.697624:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489e00, rc 0) 00000100:00100000:1.0:1788463297.697749:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:10520:x1875339395515136:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 644us (914us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788463297.697757:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 98 00000100:00100000:1.0:1788463297.705585:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.705719:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395515392 00000100:00100000:2.0:1788463297.705732:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395515392 00000100:00100000:2.0:1788463297.705803:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 99 00000100:00100000:2.0:1788463297.705819:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:10520:x1875339395515392:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463297.705853:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463297.705878:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51def5 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.706003:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee360c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.706050:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee360c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.706063:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee360c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463297.706080:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788463297.706230:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51def5 expref: 40 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.706250:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee360c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51def5 expref: 39 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.706259:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463297.706261:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788463297.706264:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e703ba00, rc 0) 00000100:00100000:2.0:1788463297.706327:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+39:10520:x1875339395515392:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 511us (758us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788463297.706334:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 99 00000100:00100000:0.0:1788463297.709658:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.709824:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395515520 00000100:00100000:3.0:1788463297.709836:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395515520 00000100:00100000:3.0:1788463297.709916:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:3.0:1788463297.709927:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+39:2354:x1875339395515520:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463297.709949:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463297.709994:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee360ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51deee expref: 39 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.710021:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:3.0:1788463297.710026:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463297.710080:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:2354:x1875339395515520:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 155us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463297.710087:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1788463297.716561:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.716656:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395515648 00000100:00100000:3.0:1788463297.716671:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395515648 00000100:00100000:3.0:1788463297.716855:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:3.0:1788463297.716868:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395515648:12345-192.168.204.11@tcp:1:lfs.0 00010000:00010000:3.0:1788463297.716974:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.717009:0:6665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.717019:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463297.717024:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463297.717029:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.717070:0:6665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 6 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.717084:0:6665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 6 pid: 6668 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463297.717099:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fec59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6665:1875339408118400:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463297.720054:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec396cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463297.729876:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fec59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6665:1875339408118400:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463297.730169:0:6665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463297.732335:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463297.733349:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395515776 00000100:00100000:0.0:1788463297.733363:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395515776 00002000:00100000:0.0:1788463297.733434:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ba5ec71d500 x1875339395515776/t0(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:433/0 lens 504/0 e 0 to 0 dl 1788463308 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463297.733445:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5ec71d500 with x1875339395515776 ext(0->8) 00010000:00010000:0.0:1788463297.733456:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 7 pid: 6668 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.733474:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 7 pid: 6668 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463297.733482:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ba5ec71d500 00000100:00100000:0.0:1788463297.733517:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:0.0:1788463297.733527:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395515776:12345-192.168.204.11@tcp:4:lfs.0 00000100:00100000:1.0:1788463297.738582:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2355:x1875339395515776:12345-192.168.204.11@tcp:4:lfs.0 Request processed in 5037us (6239us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788463297.738627:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00002000:00100000:1.0:1788463297.738653:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ba5ec71d500 x1875339395515776/t4294967302(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:433/0 lens 504/448 e 0 to 0 dl 1788463308 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463297.738668:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5ec71d500 with x1875339395515776 ext(0->8) 00010000:00010000:1.0:1788463297.738708:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 9 pid: 6668 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463297.738737:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 9 pid: 6668 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463297.738768:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ba5ec71d500 00000100:00100000:0.0:1788463297.747248:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.748016:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395515904 00000100:00100000:2.0:1788463297.748033:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395515904 00010000:00010000:2.0:1788463297.748090:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 9 pid: 6668 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.748140:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:2.0:1788463297.748152:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2355:x1875339395515904:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463297.748172:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788463297.748214:0:5803:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788463297.748217:0:5803:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788463297 00002000:00010000:2.0:1788463297.748220:0:5803:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788463298 00002000:00010000:2.0:1788463297.748222:0:5803:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788463297 00010000:00010000:2.0:1788463297.748230:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 9 pid: 6668 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.748246:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 9 pid: 6668 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.748269:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee3608f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee0 expref: 9 pid: 6668 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.748288:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463297.748291:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463297.748297:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.748308:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.748348:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463297.748426:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395515904:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 276us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463297.748434:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 50 00010000:00010000:3.0:1788463297.748663:0:6665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.748725:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.748758:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.748768:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.748776:0:6665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.748783:0:6665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463297.748788:0:6665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.748799:0:6665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.748813:0:6665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.748821:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee360ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463297.748909:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395515648:12345-192.168.204.11@tcp:1:lfs.0 Request processed in 32042us (32361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463297.748918:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:3.0:1788463297.752441:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.752603:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395516160 00000100:00100000:2.0:1788463297.752626:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395516160 00000100:00100000:2.0:1788463297.752744:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:2.0:1788463297.752774:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05a6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:10520:x1875339395516160:12345-192.168.204.11@tcp:35:lfs.0 00000004:00010000:2.0:1788463297.752867:0:5819:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee360c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51def5 expref: 38 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463297.753265:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788463297.753314:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788463297.753756:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788463297.753819:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.753837:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded2 expref: 42 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.753846:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.753897:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded2 expref: 42 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.753918:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded2 expref: 42 pid: 8864 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.753936:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5819:1875339408118528:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463297.754064:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528480 going to sleep for 11 seconds 00000100:00100000:1.0:1788463297.762255:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.763640:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395516288 00000100:00100000:3.0:1788463297.763661:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395516288 00010000:00010000:3.0:1788463297.763749:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded2 expref: 43 pid: 8864 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463297.763875:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:3.0:1788463297.763889:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+43:2355:x1875339395516288:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463297.763913:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463297.763932:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded2 expref: 43 pid: 8864 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.763959:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5819:1875339408118528:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463297.764003:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.764153:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded2 expref: 43 pid: 8864 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.764191:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee3607a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ded2 expref: 43 pid: 8864 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.764212:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:3.0:1788463297.764217:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.764229:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.764246:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.764285:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463297.764389:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+42:2355:x1875339395516288:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 502us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463297.764399:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 51 00010000:00010000:2.0:1788463297.764468:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.764476:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463297.764720:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788463297.765476:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788463297.765637:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408118656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788463297.765788:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463297.765819:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463297.765905:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408118656 00000100:00100000:0.0:1788463297.765914:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408118656 00000100:00080000:2.0:1788463297.766110:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463297.766189:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463297.766201:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1875339408118656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788463297.766274:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1875339408118656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463297.766282:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463297.766359:0:5819:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788463297.766366:0:5819:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1788463297.766385:0:5819:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5f795b480, transno 4294967301 00000100:00100000:2.0:1788463297.766403:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408118656:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788463297.766877:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788463297.767115:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408118784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788463297.767152:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463297.767167:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528480 going to sleep for 11 seconds 00000100:00100000:0.0:1788463297.767341:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408118784 00000100:00100000:0.0:1788463297.767348:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408118784 00000100:00100000:0.0:1788463297.767393:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463297.767401:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5819:x1875339408118784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788463297.767539:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5819:x1875339408118784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 138us (386us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788463297.767547:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463297.767641:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408118784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788463297.767725:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788463297.767767:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.767779:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.767806:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.767813:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703b400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.767819:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.767828:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.767849:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463297.767852:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788463297.767858:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.767866:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee360d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788463297.768223:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788463297.768296:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788463297.768305:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329378620828ns, next at 330378619388ns, rc = 0 00000001:00080000:2.0:1788463297.768311:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788463297.768341:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463297.768344:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788463297.768351:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee360c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51def5 expref: 46 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.768455:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05a6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+45:10520:x1875339395516160:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 15684us (16030us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788463297.768472:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 26 00000020:00080000:2.0:1788463297.768477:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788463297.777158:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.778170:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395516416 00000100:00100000:2.0:1788463297.778188:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395516416 00000100:00100000:2.0:1788463297.778324:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 100 00000100:00100000:2.0:1788463297.778339:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+45:10520:x1875339395516416:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463297.778368:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463297.778398:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee360dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51defc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.778495:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee360dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51defc expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.778516:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee360dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51defc expref: 46 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.778545:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463297.778550:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463297.778556:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e703ba00, rc 0) 00000100:00100000:2.0:1788463297.778771:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+46:10520:x1875339395516416:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 434us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463297.778781:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 100 00000100:00100000:0.0:1788463297.784286:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.785364:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395516672 00000100:00100000:3.0:1788463297.785379:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395516672 00000100:00100000:3.0:1788463297.785455:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:3.0:1788463297.785466:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+46:10520:x1875339395516672:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463297.785836:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+47:10520:x1875339395516672:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 371us (1564us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788463297.785847:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:0.0:1788463297.917090:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.917314:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395516800 00000100:00100000:3.0:1788463297.917330:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395516800 00000100:00100000:3.0:1788463297.917414:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 101 00000100:00100000:3.0:1788463297.917428:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+47:10530:x1875339395516800:12345-192.168.204.11@tcp:34:lfs.0 00010000:00010000:3.0:1788463297.917536:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee360e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917557:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee360e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917573:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee360e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917595:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee360ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917637:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee360ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917644:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee360ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917805:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917814:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917821:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463297.917868:0:8863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917884:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee360e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917891:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee360e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917898:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee360e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917903:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463297.917908:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee360e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917916:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee360e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917940:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:3.0:1788463297.917953:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463297.917966:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee360e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917974:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee360e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917991:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee360ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.917997:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee360ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918002:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee360ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918007:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463297.918010:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee360ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918017:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee360ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918025:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5c5b58400) 00010000:00010000:3.0:1788463297.918027:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463297.918030:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee360ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918036:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee360ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918063:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918069:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918074:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918080:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463297.918083:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918089:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918096:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:3.0:1788463297.918098:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463297.918100:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463297.918106:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee360f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463297.918193:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+47:10530:x1875339395516800:12345-192.168.204.11@tcp:34:lfs.0 Request processed in 767us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463297.918203:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 101 00000100:00100000:1.0:1788463297.957459:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463297.957655:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395517056 00000100:00100000:0.0:1788463297.957666:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395517056 00000100:00100000:0.0:1788463297.957754:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 102 00000100:00100000:0.0:1788463297.957766:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+47:10533:x1875339395517056:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463297.957789:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463297.957812:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee360f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df03 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.957899:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee360ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.957933:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee360ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.957964:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee360ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.957986:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.957994:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958001:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958143:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958152:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958160:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463297.958171:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788463297.958305:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee360ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958314:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee360ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958322:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee360ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958336:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463297.958340:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee360ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958348:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee360ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958362:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:0.0:1788463297.958365:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463297.958371:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee360ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958378:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee360ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958393:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958399:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958405:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958410:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463297.958412:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958418:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958437:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5c519a200) 00010000:00010000:0.0:1788463297.958440:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463297.958443:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958449:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958504:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee360f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df03 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958524:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df03 expref: 49 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463297.958531:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:0.0:1788463297.958533:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463297.958536:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710fa00, rc 0) 00000100:00100000:0.0:1788463297.958629:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+49:10533:x1875339395517056:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 863us (1178us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788463297.958637:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 102 00000100:00100000:0.0:1788463297.964316:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463297.964418:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395517184 00000100:00100000:2.0:1788463297.964429:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395517184 00000100:00100000:2.0:1788463297.964497:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 103 00000100:00100000:2.0:1788463297.964508:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+49:10533:x1875339395517184:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:2.0:1788463297.964603:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3611b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.964635:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3611b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.964650:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3611b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.964719:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3611b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.964726:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3611b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.964733:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3611b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.964740:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e703aa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463297.964746:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3611b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.964754:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3611b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.964767:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463297.964771:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463297.964775:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3611b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463297.964782:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3611b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463297.964890:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+49:10533:x1875339395517184:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 383us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463297.964898:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 103 00000100:00100000:2.0:1788463297.968339:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463297.968437:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395517440 00000100:00100000:3.0:1788463297.968451:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395517440 00000100:00100000:3.0:1788463297.968519:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:3.0:1788463297.968551:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+49:10533:x1875339395517440:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463297.968909:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:10533:x1875339395517440:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 361us (583us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788463297.968919:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:1.0:1788463298.056407:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463298.056656:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395517696 00000100:00100000:2.0:1788463298.056668:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395517696 00000100:00100000:2.0:1788463298.056794:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 104 00000100:00100000:2.0:1788463298.056807:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:10543:x1875339395517696:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1788463298.056836:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463298.056840:0:8864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788463298.056880:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee3609d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dee7 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.056910:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463298.056916:0:8864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463298.056935:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee36122 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df0a expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.057107:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.057125:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df03 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.057134:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.057206:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df03 expref: 50 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.057221:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df03 expref: 50 pid: 5817 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463298.057237:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408118912:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463298.057348:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec804a80 going to sleep for 11 seconds 00000100:00080000:3.0:1788463298.058157:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463298.061847:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463298.061931:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395517824 00000100:00100000:3.0:1788463298.061954:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395517824 00010000:00010000:3.0:1788463298.062006:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df03 expref: 51 pid: 5817 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463298.062049:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:3.0:1788463298.062061:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+51:2355:x1875339395517824:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463298.062078:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463298.062086:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df03 expref: 51 pid: 5817 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.062101:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df03 expref: 51 pid: 5817 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.062125:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:3.0:1788463298.062132:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.062142:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.062151:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.062194:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463298.062249:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+51:2355:x1875339395517824:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 190us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463298.062256:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 52 00010000:00010000:2.0:1788463298.062482:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3610d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df03 expref: 50 pid: 5817 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463298.062500:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408118912:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463298.062524:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.062536:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.062542:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463298.062563:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788463298.062769:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee36122 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df0a expref: 51 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.062785:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df0a expref: 50 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.062803:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463298.062806:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463298.062809:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e703b400, rc 0) 00000100:00100000:2.0:1788463298.062837:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:10543:x1875339395517696:12345-192.168.204.11@tcp:101:bash.0 Request processed in 6033us (6441us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788463298.062844:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 104 00000100:00100000:1.0:1788463298.067271:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463298.067425:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395518080 00000100:00100000:0.0:1788463298.067439:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395518080 00000100:00100000:0.0:1788463298.067515:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 105 00000100:00100000:0.0:1788463298.067528:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:10543:x1875339395518080:12345-192.168.204.11@tcp:36:bash.0 00010000:00010000:0.0:1788463298.068006:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.068059:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.068078:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463298.068150:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788463298.068180:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0c9a3f8 reply state 000000009572bf2f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463298.068190:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788463298.068303:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10543:x1875339395518080:12345-192.168.204.11@tcp:36:bash.0 Request processed in 776us (1042us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788463298.068311:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 105 00000020:00080000:0.0:1788463298.068317:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788463298.073569:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00010000:00010000:3.0:1788463298.073881:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.073898:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.073907:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.073913:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463298.073920:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.073930:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.073968:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:3.0:1788463298.073972:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463298.073979:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463298.073986:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36137 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463298.074582:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395518208 00000100:00100000:2.0:1788463298.074597:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395518208 00000100:00100000:2.0:1788463298.074895:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 106 00000100:00100000:2.0:1788463298.074907:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10543:x1875339395518208:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1788463298.074940:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463298.075096:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3613e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df11 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.075229:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.075244:0:8863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df0a expref: 53 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.075254:0:8863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.075299:0:8863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df0a expref: 53 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.075316:0:8863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df0a expref: 53 pid: 8864 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463298.075351:0:8863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408119040:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463298.075464:0:8863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec804e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463298.079893:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463298.080098:0:8863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408119040:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463298.080130:0:8863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463298.080217:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395518336 00000100:00100000:0.0:1788463298.080225:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395518336 00010000:00010000:0.0:1788463298.080268:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df0a expref: 54 pid: 8864 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463298.080341:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:0.0:1788463298.080353:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:2355:x1875339395518336:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463298.080370:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463298.080377:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df0a expref: 54 pid: 8864 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.080391:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df0a expref: 54 pid: 8864 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.080426:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee36129 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df0a expref: 54 pid: 8864 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.080444:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:0.0:1788463298.080450:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.080460:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.080468:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.080504:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463298.080572:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:2355:x1875339395518336:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 221us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463298.080580:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 53 00010000:00010000:2.0:1788463298.080710:0:8863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.080721:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463298.080774:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788463298.080779:0:8863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463298.080800:0:8863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.080832:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3613e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df11 expref: 53 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.080848:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df11 expref: 52 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.080855:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463298.080857:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463298.080860:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e703a000, rc 0) 00000100:00100000:2.0:1788463298.080886:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10543:x1875339395518208:12345-192.168.204.11@tcp:101:bash.0 Request processed in 5982us (7337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463298.080894:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 106 00000100:00100000:1.0:1788463298.086587:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463298.087106:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395518592 00000100:00100000:3.0:1788463298.087120:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395518592 00000100:00100000:2.0:1788463298.087440:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:2.0:1788463298.087455:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:10543:x1875339395518592:12345-192.168.204.11@tcp:35:bash.0 00000100:00100000:2.0:1788463298.087793:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10543:x1875339395518592:12345-192.168.204.11@tcp:35:bash.0 Request processed in 340us (1215us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788463298.087801:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:1.0:1788463298.158452:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463298.158573:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395518720 00000100:00100000:2.0:1788463298.158588:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395518720 00000100:00100000:2.0:1788463298.158734:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 107 00000100:00100000:2.0:1788463298.158763:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+53:10549:x1875339395518720:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463298.158793:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463298.158816:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3614c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df18 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.158894:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.158911:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.158923:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463298.158979:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788463298.158984:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463298.159007:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.159042:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703aa00/0xc3fe72277ee3614c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df18 expref: 55 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.159064:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df18 expref: 54 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.159088:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463298.159091:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463298.159096:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e703a600, rc 0) 00000100:00100000:2.0:1788463298.159159:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10549:x1875339395518720:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 415us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463298.159166:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 107 00000100:00100000:1.0:1788463298.163858:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463298.164014:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395518848 00000100:00100000:2.0:1788463298.164026:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395518848 00000100:00100000:2.0:1788463298.164094:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 108 00000100:00100000:2.0:1788463298.164105:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10549:x1875339395518848:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463298.164127:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463298.164155:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee3615a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df1f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164230:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36161 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164245:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36161 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164259:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36161 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164273:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee36168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164280:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee36168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164299:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee36168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164395:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164403:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164410:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463298.164450:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788463298.164455:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463298.164474:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164486:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164494:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36161 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164501:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36161 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164509:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164515:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8ca600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463298.164519:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164536:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164551:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463298.164553:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463298.164560:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164567:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8ca600/0xc3fe72277ee36161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164583:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee36168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164588:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee36168 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164593:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee36168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164598:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cae00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463298.164600:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee36168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164623:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee36168 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164629:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5d0c1e000) 00010000:00010000:2.0:1788463298.164632:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463298.164634:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee36168 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164649:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cae00/0xc3fe72277ee36168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164681:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703b400/0xc3fe72277ee3615a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df1f expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164840:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df1f expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.164847:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463298.164850:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463298.164853:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5ca8cac00, rc 0) 00000100:00100000:2.0:1788463298.165036:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10549:x1875339395518848:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 932us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463298.165044:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 108 00000100:00100000:3.0:1788463298.169512:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463298.169554:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463298.169629:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395519104 00000100:00100000:2.0:1788463298.169641:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395519104 00000100:00100000:2.0:1788463298.169739:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 109 00000100:00100000:2.0:1788463298.169754:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10549:x1875339395519104:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463298.169783:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463298.169808:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df26 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.170005:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.170023:0:8863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df11 expref: 56 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.170038:0:8863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df1f expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.170048:0:8863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.170087:0:8863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df1f expref: 56 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.170103:0:8863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df1f expref: 56 pid: 5816 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463298.170120:0:8863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d36300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408119168:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463298.170237:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395519232 00000100:00100000:0.0:1788463298.170243:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395519232 00010000:00010000:0.0:1788463298.170269:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df1f expref: 57 pid: 5816 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463298.170296:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 54 00000100:00100000:0.0:1788463298.170303:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:2355:x1875339395519232:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463298.170312:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463298.170317:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df1f expref: 57 pid: 5816 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.170340:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df1f expref: 57 pid: 5816 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.170363:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:0.0:1788463298.170367:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.170374:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.170380:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463298.171415:0:8863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df11 expref: 57 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.171433:0:8863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df11 expref: 57 pid: 8863 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463298.171446:0:8863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d34000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408119296:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463298.171514:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:2355:x1875339395519232:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 1208us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463298.171524:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 54 00000100:00100000:2.0:1788463298.174566:0:8863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec804a80 going to sleep for 11 seconds 00010000:00010000:2.0:1788463298.174638:0:8863:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.11@tcp) returned -22 from blocking AST (req@000000005d16710f x1875339408119168) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df1f expref: 56 pid: 5816 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.174664:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cac00/0xc3fe72277ee3616f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df1f expref: 56 pid: 5816 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463298.174728:0:8863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d36300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408119168:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463298.178679:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463298.178792:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395519360 00000100:00100000:1.0:1788463298.178804:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395519360 00010000:00010000:1.0:1788463298.178850:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df11 expref: 56 pid: 8863 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463298.178895:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:1.0:1788463298.178906:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c8990c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:2354:x1875339395519360:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463298.178929:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463298.178937:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df11 expref: 56 pid: 8863 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463298.179268:0:8863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d34000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408119296:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463298.179296:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463298.179302:0:8863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.179313:0:8863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.179324:0:8863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463298.179385:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df11 expref: 56 pid: 8863 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463298.179412:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a000/0xc3fe72277ee36145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df11 expref: 56 pid: 8863 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463298.179448:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:1.0:1788463298.179452:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463298.179461:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463298.179470:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463298.179501:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463298.179590:0:8863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.179597:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463298.179636:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788463298.179893:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cb600/0xc3fe72277ee36176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df26 expref: 57 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.179910:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df26 expref: 56 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.179917:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463298.179920:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463298.179930:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39c00, rc 0) 00000100:00100000:1.0:1788463298.180556:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c8990c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:2354:x1875339395519360:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 1646us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463298.180572:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:2.0:1788463298.181211:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10549:x1875339395519104:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 11455us (11704us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788463298.181221:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 109 00000100:00100000:3.0:1788463298.184480:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463298.184831:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395519616 00000100:00100000:0.0:1788463298.184844:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395519616 00000100:00100000:0.0:1788463298.185081:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:0.0:1788463298.185093:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10549:x1875339395519616:12345-192.168.204.11@tcp:103:lfs.0 00010000:00010000:0.0:1788463298.185111:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463298.185139:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703ba00/0xc3fe72277ee360dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51defc expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463298.185160:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:0.0:1788463298.185168:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463298.185265:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10549:x1875339395519616:12345-192.168.204.11@tcp:103:lfs.0 Request processed in 174us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463298.185291:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:3.0:1788463298.187823:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463298.188190:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395519744 00000100:00100000:2.0:1788463298.188204:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395519744 00000100:00100000:2.0:1788463298.188303:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 110 00000100:00100000:2.0:1788463298.188317:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10549:x1875339395519744:12345-192.168.204.11@tcp:58:lfs.0 00010000:00010000:2.0:1788463298.188495:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.188522:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.188541:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463298.188898:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788463298.189209:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10549:x1875339395519744:12345-192.168.204.11@tcp:58:lfs.0 Request processed in 893us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463298.189218:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 110 00000100:00100000:1.0:1788463298.196297:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463298.196484:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395519872 00000100:00100000:2.0:1788463298.196496:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395519872 00000100:00100000:2.0:1788463298.196820:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 111 00000100:00100000:2.0:1788463298.196833:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:10549:x1875339395519872:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463298.196863:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463298.196892:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38600/0xc3fe72277ee36192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df2d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.197071:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.197083:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38600/0xc3fe72277ee36192 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df2d expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.197104:0:5816:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.197117:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38600/0xc3fe72277ee36192 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df2d expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.197132:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463298.197136:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463298.197140:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38600/0xc3fe72277ee36192 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df2d expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463298.197148:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38600, rc 0) 00000100:00100000:2.0:1788463298.197260:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10549:x1875339395519872:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 429us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463298.197267:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 111 00010000:00010000:1.0:1788463298.404868:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463298.981075:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463298.981091:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463298.981149:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788463298.981158:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463298.981335:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408119424:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788463298.981460:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463298.987758:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408119424:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788463298.993531:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463298.994204:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395520000 00000100:00100000:2.0:1788463298.994216:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395520000 00000100:00100000:2.0:1788463298.994280:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 112 00000100:00100000:2.0:1788463298.994290:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10550:x1875339395520000:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788463298.994327:0:8863:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788463298.994469:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10550:x1875339395520000:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 180us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463298.994477:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 112 00000100:00100000:1.0:1788463299.012392:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.013300:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395520128 00000100:00100000:2.0:1788463299.013312:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395520128 00000100:00100000:2.0:1788463299.013386:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 113 00000100:00100000:2.0:1788463299.013396:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10550:x1875339395520128:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788463299.013486:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36199 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013506:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36199 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013520:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36199 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013609:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013617:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013624:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013648:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013656:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013662:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463299.013784:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788463299.013790:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463299.013809:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013821:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36199 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013829:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36199 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013836:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36199 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013842:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463299.013847:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36199 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013857:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36199 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013869:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:2.0:1788463299.013872:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463299.013878:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36199 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013903:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36199 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013923:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013938:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361a0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013945:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013949:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463299.013952:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013958:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361a0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013980:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9ba5d0c1e000) 00010000:00010000:2.0:1788463299.013983:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463299.013986:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361a0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.013992:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.014010:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.014017:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.014024:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.014029:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463299.014039:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.014045:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.014053:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463299.014055:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463299.014059:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.014065:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463299.015379:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10550:x1875339395520128:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 Request processed in 1973us (2991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463299.015394:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 113 00000100:00100000:3.0:1788463299.026211:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.026655:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395520384 00000100:00100000:2.0:1788463299.026672:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395520384 00000100:00100000:2.0:1788463299.026818:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 114 00000100:00100000:2.0:1788463299.026833:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:10550:x1875339395520384:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463299.026865:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463299.026895:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df34 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027072:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027091:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027124:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463299.027137:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788463299.027263:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027271:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027278:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027284:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463299.027289:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027297:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027310:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463299.027313:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788463299.027319:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027324:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027372:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361ae lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df34 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027395:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:2.0:1788463299.027398:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463299.027403:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38e00/0xc3fe72277ee361ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df34 expref: 57 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.027415:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38e00, rc 0) 00000100:00100000:2.0:1788463299.027489:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:10550:x1875339395520384:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 659us (1290us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788463299.027496:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 114 00000100:00100000:1.0:1788463299.043260:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463299.043390:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395520512 00000100:00100000:0.0:1788463299.043403:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395520512 00000100:00100000:0.0:1788463299.043480:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 115 00000100:00100000:0.0:1788463299.043492:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:10550:x1875339395520512:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788463299.043535:0:5817:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788463299.043677:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:10550:x1875339395520512:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 186us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463299.043729:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 115 00000100:00100000:1.0:1788463299.052261:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.055277:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395520768 00000100:00100000:2.0:1788463299.055293:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395520768 00000100:00100000:2.0:1788463299.055377:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 116 00000100:00100000:2.0:1788463299.055389:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:10550:x1875339395520768:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463299.055414:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463299.055417:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788463299.055448:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e703a600/0xc3fe72277ee36153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df18 expref: 56 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.055470:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463299.055475:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463299.055491:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df3b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788463299.056629:0:5818:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788463299.056921:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee361ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.056957:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee361ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.056970:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee361ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.057030:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df3b expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.057046:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee361ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df3b expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.057055:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5d0c1e000) 00010000:00010000:2.0:1788463299.057058:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463299.057061:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39000, rc 0) 00000100:00100000:2.0:1788463299.057126:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:10550:x1875339395520768:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 1738us (6247us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788463299.057134:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 116 00000100:00100000:2.0:1788463299.064433:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463299.064665:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395521024 00000100:00100000:3.0:1788463299.064676:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395521024 00000100:00100000:3.0:1788463299.064771:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 117 00000100:00100000:3.0:1788463299.064783:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:10550:x1875339395521024:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463299.064851:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463299.064881:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee361ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df3b expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.064912:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5d0c1e000) 00010000:00010000:3.0:1788463299.064924:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463299.065158:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee361d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065174:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee361d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065184:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee361d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065198:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xfda27783 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065221:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfda27783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065229:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfda27783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065295:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee361d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065303:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee361d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065309:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee361d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065315:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463299.065319:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee361d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065326:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee361d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065334:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:3.0:1788463299.065337:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463299.065340:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee361d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065346:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee361d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065356:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xfda27783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065368:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfda27783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065373:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfda27783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065377:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463299.065381:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfda27783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065387:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xfda27783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065395:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xfda27783 (ffff9ba5c5b58400) 00010000:00010000:3.0:1788463299.065397:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463299.065399:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfda27783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.065405:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xfda27783 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463299.065496:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:10550:x1875339395521024:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 714us (1075us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463299.065504:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 117 00000100:00100000:1.0:1788463299.069391:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463299.069468:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395521152 00000100:00100000:3.0:1788463299.069482:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395521152 00000100:00100000:3.0:1788463299.069557:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 118 00000100:00100000:3.0:1788463299.069566:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:10550:x1875339395521152:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463299.069604:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463299.069661:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee361e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df42 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.069767:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.069784:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.069798:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.069943:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee361e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df42 expref: 58 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.069968:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df42 expref: 57 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.069979:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c5b58500) 00010000:00010000:3.0:1788463299.069982:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463299.069987:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1600, rc 0) 00000100:00100000:3.0:1788463299.070078:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:10550:x1875339395521152:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 512us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463299.070086:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 118 00000100:00100000:1.0:1788463299.077561:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.077861:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395521408 00000100:00100000:2.0:1788463299.077875:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395521408 00000100:00100000:2.0:1788463299.079302:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 119 00000100:00100000:2.0:1788463299.079316:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:10550:x1875339395521408:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788463299.079421:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.079448:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.079481:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463299.079807:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788463299.079817:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330690131742ns, next at 331690129005ns, rc = 0 00000004:00010000:2.0:1788463299.080199:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040f25b05 reply state 0000000031e6ed3b transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463299.080211:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463299.080324:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:10550:x1875339395521408:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 1009us (2772us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788463299.080333:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 119 00010000:00010000:3.0:1788463299.083271:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.083293:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.083301:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.083323:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463299.083329:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.083337:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.083357:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c5b58500) 00010000:00010000:3.0:1788463299.083361:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788463299.083368:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.083374:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee361f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463299.086241:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463299.086527:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395521536 00000100:00100000:3.0:1788463299.086541:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395521536 00000100:00100000:3.0:1788463299.086627:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 120 00000100:00100000:3.0:1788463299.086641:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+58:10550:x1875339395521536:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463299.086674:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463299.086723:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df49 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.086809:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df49 expref: 59 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.086825:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df49 expref: 59 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.086873:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c5b58500) 00010000:00010000:3.0:1788463299.086877:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463299.086881:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0c00, rc 0) 00000100:00100000:3.0:1788463299.087382:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:10550:x1875339395521536:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 743us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463299.087391:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 120 00000100:00100000:0.0:1788463299.092993:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463299.093166:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395521664 00000100:00100000:3.0:1788463299.093181:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395521664 00000100:00100000:3.0:1788463299.093271:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:3.0:1788463299.093283:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395521664:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788463299.093673:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2354:x1875339395521664:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 391us (696us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788463299.093719:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00080000:2.0:1788463299.093929:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463299.101794:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463299.102489:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395521920 00000100:00100000:0.0:1788463299.102505:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395521920 00000100:00100000:0.0:1788463299.102580:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:0.0:1788463299.102603:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:10550:x1875339395521920:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788463299.103200:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:10550:x1875339395521920:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 598us (1420us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788463299.103208:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:0.0:1788463299.106285:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.106379:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395522176 00000100:00100000:2.0:1788463299.106390:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395522176 00000100:00100000:2.0:1788463299.106453:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 121 00000100:00100000:2.0:1788463299.106464:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:10550:x1875339395522176:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788463299.106624:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:10550:x1875339395522176:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 161us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463299.106632:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 121 00000100:00100000:3.0:1788463299.111359:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408119552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463299.111459:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463299.111613:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408119552 00000100:00100000:0.0:1788463299.111623:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408119552 00000100:00100000:0.0:1788463299.111755:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788463299.111767:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408119552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463299.111807:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463299.111859:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408119552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463299.111867:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788463299.111975:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463299.112021:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408119552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463299.117905:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463299.118417:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395522304 00000100:00100000:0.0:1788463299.118430:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395522304 00000100:00100000:0.0:1788463299.118493:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 122 00000100:00100000:0.0:1788463299.118502:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:10550:x1875339395522304:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463299.118522:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463299.118546:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36202 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df50 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.119103:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.119122:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.119134:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463299.119172:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463299.119194:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.119243:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36202 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df50 expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.119263:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df50 expref: 61 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.119271:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c5b58500) 00010000:00010000:0.0:1788463299.119274:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788463299.119279:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710fa00, rc 0) 00000100:00100000:0.0:1788463299.119417:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:10550:x1875339395522304:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 915us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463299.119424:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 122 00000100:00100000:1.0:1788463299.132754:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463299.133000:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395522432 00000100:00100000:3.0:1788463299.133014:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395522432 00000100:00100000:3.0:1788463299.133099:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:3.0:1788463299.133112:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2355:x1875339395522432:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463299.133136:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463299.133168:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee36210 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df57 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463299.133225:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99c8c3, blocks: 0x1 00010000:00010000:3.0:1788463299.133247:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1788463299.133251:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463299.133262:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee36210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df57 expref: 10 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.133284:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee36210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df57 expref: 10 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.133315:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1000, rc 0) 00000100:00100000:3.0:1788463299.133403:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:2355:x1875339395522432:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 294us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463299.133411:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:1.0:1788463299.144744:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.148616:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395522688 00000100:00100000:2.0:1788463299.148635:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395522688 00000100:00100000:2.0:1788463299.148733:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 123 00000100:00100000:2.0:1788463299.148742:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:10550:x1875339395522688:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788463299.148893:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:10550:x1875339395522688:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 142us (4154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463299.148923:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 123 00000100:00100000:2.0:1788463299.158285:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463299.158381:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395522816 00000100:00100000:3.0:1788463299.158392:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395522816 00000100:00100000:3.0:1788463299.158456:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:3.0:1788463299.158469:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:10550:x1875339395522816:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463299.158494:0:8660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463299.158520:0:8660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df5e expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.158558:0:8660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee36210 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df57 expref: 11 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.158605:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463299.158610:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463299.158617:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 11 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.158662:0:8660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee36210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df57 expref: 11 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.158678:0:8660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee36210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df57 expref: 11 pid: 6667 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463299.158738:0:8660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fec58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8660:1875339408119680:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463299.158858:0:8660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cc0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463299.173239:0:8660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fec58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8660:1875339408119680:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463299.173278:0:8660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 11 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.173302:0:8660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0600, rc 0) 00000100:00100000:3.0:1788463299.173367:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+11:10550:x1875339395522816:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 14900us (15095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463299.173376:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:0.0:1788463299.180147:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463299.180325:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395522944 00000100:00100000:1.0:1788463299.180352:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395522944 00010000:00010000:1.0:1788463299.180395:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee36210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df57 expref: 11 pid: 6667 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463299.180441:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:1.0:1788463299.180451:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+11:2354:x1875339395522944:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463299.180467:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463299.180492:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee36210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df57 expref: 11 pid: 6667 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.180508:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee36210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df57 expref: 11 pid: 6667 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.180532:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000460ac03d/0xc3fe72277ee36210 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df57 expref: 11 pid: 6667 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.180550:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463299.180555:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463299.180564:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 10 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.180576:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 10 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.180640:0:8442:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 10 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463299.180670:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ebc8c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8442:1875339408119808:192.168.204.11@tcp:105: 00000100:00100000:1.0:1788463299.180846:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463299.190287:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463299.190759:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ebc8c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8442:1875339408119808:192.168.204.11@tcp:105: 00000100:00100000:3.0:1788463299.190936:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395523072 00000100:00100000:3.0:1788463299.190948:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395523072 00002000:00100000:3.0:1788463299.191146:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ba5f7d37100 x1875339395523072/t0(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:435/0 lens 504/0 e 0 to 0 dl 1788463310 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463299.191174:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5f7d37100 with x1875339395523072 ext(0->12) 00002000:00010000:3.0:1788463299.191181:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5f7d37100 00010000:00010000:1.0:1788463299.191216:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463299.191261:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:3.0:1788463299.191273:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+11:2355:x1875339395523072:12345-192.168.204.11@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788463299.191501:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+11:2354:x1875339395522944:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 11048us (11369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463299.191515:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:3.0:1788463299.191867:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:2355:x1875339395523072:12345-192.168.204.11@tcp:4:lhsmtool_posix.0 Request processed in 596us (1593us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788463299.191874:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00002000:00100000:3.0:1788463299.191882:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ba5f7d37100 x1875339395523072/t4294967308(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:435/0 lens 504/448 e 0 to 0 dl 1788463310 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463299.191892:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5f7d37100 with x1875339395523072 ext(0->12) 00002000:00010000:3.0:1788463299.191909:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5f7d37100 00000100:00100000:1.0:1788463299.201762:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463299.203225:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395523200 00000100:00100000:0.0:1788463299.203241:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395523200 00000100:00100000:0.0:1788463299.203330:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 124 00000100:00100000:0.0:1788463299.203342:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:10550:x1875339395523200:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788463299.309932:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:10550:x1875339395523200:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 Request processed in 106575us (108168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463299.309964:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 124 00000001:00080000:0.0:1788463299.310129:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1788463299.310157:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ba5ec804300 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788463299.310162:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5ebdffc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5ec8043c0 00000020:00080000:0.0:1788463299.310165:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5ebdff000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5c5d71800 00000020:00080000:0.0:1788463299.310181:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:0.0:1788463299.310205:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788463299.310240:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788463299.310253:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ba5c8528780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788463299.310272:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c2ea9800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5c85289c0 00000020:00080000:0.0:1788463299.310275:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c2ea9f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5ec3d1c00 00000004:00080000:0.0:1788463299.310294:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:3.0:1788463299.310810:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463299.310830:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408119936:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788463299.310898:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463299.310995:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408119936 00000100:00100000:3.0:1788463299.311005:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408119936 00000100:00100000:3.0:1788463299.311052:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000020:00080000:2.0:1788463299.311775:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1788463299.312952:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408119936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788463299.313022:0:6667:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000100:00100000:0.0:1788463299.313831:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408120064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788463299.313968:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788463299.314245:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1788463299.314392:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.314433:0:6667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000031d9a42/0xc3fe72277ee35fe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51debd expref: 11 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.314476:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788463299.314494:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463299.314502:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.314559:0:6667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000031d9a42/0xc3fe72277ee35fe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51debd expref: 11 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.314602:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000031d9a42/0xc3fe72277ee35fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51debd expref: 11 pid: 8660 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463299.314619:0:6667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fec5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6667:1875339408120320:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463299.314817:0:6667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cc0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463299.314911:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463299.314923:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408120192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788463299.314966:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463299.316427:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408120064 00000100:00100000:1.0:1788463299.316449:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408120064 00000100:00100000:1.0:1788463299.316532:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408120192 00000100:00100000:1.0:1788463299.316535:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408120192 00000100:00100000:1.0:1788463299.316594:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788463299.316607:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3278:x1875339408120064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788463299.316897:0:6668:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788463299.316902:0:6668:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788463299 00002000:00010000:1.0:1788463299.316905:0:6668:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788463299.316907:0:6668:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788463299 -> 1788463299 00002000:00010000:1.0:1788463299.316911:0:6668:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:0.0:1788463299.317056:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463299.317430:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3278:x1875339408120064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 822us (3460us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788463299.317440:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788463299.317467:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788463299.317486:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875339408120192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788463299.317532:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788463299.317573:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a99c8c1, atime: 0x6a99c8c2, ctime: 0x6a99c8c1, blocks: 0x1 00010000:00010000:1.0:1788463299.317593:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36225 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.317614:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1788463299.317620:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463299.317630:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36225 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.317793:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36225 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.317806:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36225 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.317814:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36225 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.317842:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788463299.318668:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5ec22bb80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788463299.318679:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408120064:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788463299.319327:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3278:x1875339408120192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1850us (4358us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788463299.319337:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1788463299.319539:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463299.319549:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36225 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.319563:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463299.319568:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36225 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.319591:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36225 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.319632:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36225 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.319651:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36225 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.319676:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463299.319678:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463299.319680:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788463299.320576:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5ec436d80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788463299.320601:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408120192:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788463299.320792:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463299.320897:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395523328 00000100:00100000:1.0:1788463299.320909:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395523328 00000100:00100000:1.0:1788463299.320989:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:1.0:1788463299.321000:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:2355:x1875339395523328:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788463299.327374:0:6667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fec5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6667:1875339408120320:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463299.327410:0:6667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463299.330379:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463299.330913:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395523456 00000100:00100000:0.0:1788463299.330940:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395523456 00010000:00010000:0.0:1788463299.331013:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000031d9a42/0xc3fe72277ee35fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51debd expref: 13 pid: 8660 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463299.331200:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:0.0:1788463299.331214:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2355:x1875339395523456:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463299.331237:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463299.331244:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000031d9a42/0xc3fe72277ee35fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51debd expref: 13 pid: 8660 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.331260:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000031d9a42/0xc3fe72277ee35fe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51debd expref: 13 pid: 8660 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.331319:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000031d9a42/0xc3fe72277ee35fe0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51debd expref: 13 pid: 8660 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.331341:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463299.331347:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463299.331355:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.331369:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.331404:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463299.331463:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:2355:x1875339395523456:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 253us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463299.331471:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 57 00010000:00010000:2.0:1788463299.334591:0:6667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.334611:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.334624:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.334631:0:6667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.334661:0:6667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788463299.335332:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3276:x1875339408119936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24267us (24428us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788463299.335344:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788463299.335381:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463299.335388:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.335397:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463299.335402:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.335411:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.335433:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.335440:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3621e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.335463:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463299.335465:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463299.335467:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788463299.335513:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5ec229500/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788463299.335521:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408119936:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788463299.397924:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788463299.397964:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788463299.397972:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1788463299.398254:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395523328:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 Request processed in 77247us (77458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463299.398266:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:1.0:1788463299.404120:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.404251:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395523712 00000100:00100000:2.0:1788463299.404261:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395523712 00000100:00100000:2.0:1788463299.404324:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 125 00000100:00100000:2.0:1788463299.404334:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:10550:x1875339395523712:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788463299.404385:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463299.404413:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df50 expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.404433:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c5b58500) 00010000:00010000:2.0:1788463299.404438:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463299.404466:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.404480:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.404491:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463299.404754:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000274602b reply state 0000000074ef9178 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463299.404764:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463299.404871:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:10550:x1875339395523712:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 538us (763us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788463299.404879:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 125 00010000:00010000:1.0:1788463299.408459:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.408479:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.408488:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.408495:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463299.408501:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.408509:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.408527:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c5b58500) 00010000:00010000:1.0:1788463299.408530:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463299.408536:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.408544:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee3622c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463299.409015:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463299.409075:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395523840 00000100:00100000:3.0:1788463299.409086:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395523840 00000100:00100000:3.0:1788463299.409145:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:3.0:1788463299.409156:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395523840:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788463299.409417:0:6665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788463299.409421:0:6665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788463299 -> 1788463298 00002000:00010000:3.0:1788463299.409424:0:6665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788463298 00002000:00010000:3.0:1788463299.409426:0:6665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788463299 -> 1788463298 00002000:00010000:3.0:1788463299.409429:0:6665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788463299.409493:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395523840:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 338us (483us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788463299.409520:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:3.0:1788463299.414807:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463299.414915:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395524096 00000100:00100000:0.0:1788463299.414940:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395524096 00000100:00100000:0.0:1788463299.415025:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00100000:0.0:1788463299.415039:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:10550:x1875339395524096:12345-192.168.204.11@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788463299.415121:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.415141:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df42 expref: 15 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.415150:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.415212:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df42 expref: 15 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.415227:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df42 expref: 15 pid: 8864 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463299.415242:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408120448:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463299.415345:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463299.422795:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec434e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408120448:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463299.422826:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463299.425491:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463299.425597:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395524224 00000100:00100000:0.0:1788463299.425609:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395524224 00010000:00010000:0.0:1788463299.425661:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df42 expref: 16 pid: 8864 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463299.425739:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:0.0:1788463299.425748:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5bead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:2355:x1875339395524224:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463299.425763:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463299.425770:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df42 expref: 16 pid: 8864 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.425783:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df42 expref: 16 pid: 8864 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.425833:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee361ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df42 expref: 16 pid: 8864 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.425854:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c5b58500) 00010000:00010000:0.0:1788463299.425860:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.425872:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.425881:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.425906:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463299.425982:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5bead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:2355:x1875339395524224:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 235us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463299.425990:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 58 00010000:00010000:2.0:1788463299.426867:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.426881:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.426938:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.426945:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.426960:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.426966:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463299.426971:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.426979:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.426994:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c5b58500) 00010000:00010000:2.0:1788463299.427006:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788463299.427010:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.427016:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36233 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463299.427148:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:10550:x1875339395524096:12345-192.168.204.11@tcp:55:lhsmtool_posix.0 Request processed in 12111us (12350us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788463299.427158:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 126 00010000:00010000:1.0:1788463299.434284:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463299.437185:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.437280:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395524352 00000100:00100000:2.0:1788463299.437292:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395524352 00000100:00100000:2.0:1788463299.437378:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:2.0:1788463299.437408:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2356:x1875339395524352:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788463299.437475:0:6667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.437500:0:6667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 7 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.437510:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788463299.437515:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463299.437520:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.437571:0:6667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 7 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.437599:0:6667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 7 pid: 8660 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463299.437618:0:6667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6667:1875339408120576:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463299.437761:0:6667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec39b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463299.441940:0:6667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6667:1875339408120576:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463299.441983:0:6667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463299.443207:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463299.445443:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395524480 00000100:00100000:0.0:1788463299.445456:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395524480 00010000:00010000:0.0:1788463299.445513:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 8 pid: 8660 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463299.445972:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:0.0:1788463299.445983:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395524480:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463299.445999:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463299.446023:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 8 pid: 8660 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.446061:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 8 pid: 8660 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.446085:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dc7527a/0xc3fe72277ee36217 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df5e expref: 8 pid: 8660 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.446103:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463299.446107:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463299.446114:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.446124:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.446163:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463299.446229:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395524480:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 248us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463299.446236:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 59 00010000:00010000:1.0:1788463299.446304:0:6667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.446315:0:6667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.446348:0:6667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.446357:0:6667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.446367:0:6667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.446374:0:6667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463299.446379:0:6667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.446389:0:6667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.446400:0:6667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.446408:0:6667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002b5ff29/0xc3fe72277ee3623a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463299.446464:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395524352:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 Request processed in 9059us (9294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463299.446473:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:0.0:1788463299.454370:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.454600:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395524736 00000100:00100000:2.0:1788463299.454630:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395524736 00000100:00100000:2.0:1788463299.454759:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 127 00000100:00100000:2.0:1788463299.454770:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:10550:x1875339395524736:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788463299.454858:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36241 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.454881:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.454894:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.455405:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.455420:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df49 expref: 15 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.456100:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.456165:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df49 expref: 15 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.456183:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df49 expref: 15 pid: 8863 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463299.456201:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408120704:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463299.456317:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec39b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463299.464374:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408120704:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463299.464427:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463299.465217:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.465846:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395524864 00000100:00100000:2.0:1788463299.465861:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395524864 00010000:00010000:2.0:1788463299.465925:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df49 expref: 16 pid: 8863 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463299.466049:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:2.0:1788463299.466062:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:2355:x1875339395524864:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463299.466081:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463299.466088:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df49 expref: 16 pid: 8863 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.466101:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df49 expref: 16 pid: 8863 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.466128:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee361fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df49 expref: 16 pid: 8863 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.466151:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c5b58500) 00010000:00010000:2.0:1788463299.466157:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.466168:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.466177:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.466233:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463299.466303:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:2355:x1875339395524864:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 244us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463299.466311:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 60 00010000:00010000:0.0:1788463299.467122:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.467135:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463299.467390:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788463299.467611:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788463299.467665:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788463299.467865:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5818:1875339408120832:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788463299.467938:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463299.468060:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463299.468089:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408120832 00000100:00100000:0.0:1788463299.468096:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408120832 00000100:00100000:0.0:1788463299.468158:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463299.468168:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1875339408120832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788463299.468246:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1875339408120832:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463299.468252:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463299.468297:0:5818:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788463299.468303:0:5818:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5ec229880, transno 4294967303 00000004:00080000:0.0:1788463299.468313:0:5818:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1788463299.468345:0:5818:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5ec22bb80, transno 4294967309 00000100:00100000:0.0:1788463299.468353:0:5818:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ba5ec229500 x1875339408119936/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788463315 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463299.468368:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5818:1875339408120832:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788463299.470407:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788463299.470557:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5818:1875339408120960:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788463299.474407:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463299.474474:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5edc42c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463299.475960:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408120960 00000100:00100000:3.0:1788463299.475984:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408120960 00000100:00100000:3.0:1788463299.476067:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463299.476078:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5818:x1875339408120960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788463299.476392:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5818:x1875339408120960:12345-0@lo:1000:mdt00_002.0 Request processed in 315us (1997us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788463299.476400:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463299.476491:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5818:1875339408120960:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788463299.476548:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476559:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476566:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476572:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463299.476588:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476598:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476651:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c5b58500) 00010000:00010000:3.0:1788463299.476655:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463299.476661:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476668:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36248 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476744:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476752:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476758:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476763:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463299.476766:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476772:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476781:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:3.0:1788463299.476783:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463299.476791:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38600/0xc3fe72277ee36192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df2d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476803:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38600/0xc3fe72277ee36192 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df2d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476821:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38600/0xc3fe72277ee36192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df2d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.476868:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38600/0xc3fe72277ee36192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df2d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463299.476885:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b15180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408121088:192.168.204.11@tcp:105: 00000100:00100000:3.0:1788463299.476983:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee240 going to sleep for 11 seconds 00000100:00100000:2.0:1788463299.481732:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463299.481814:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395524992 00000100:00100000:1.0:1788463299.481824:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395524992 00000100:00100000:1.0:1788463299.481890:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:1.0:1788463299.481903:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:10549:x1875339395524992:12345-192.168.204.11@tcp:49:lfs.0 00000100:00100000:1.0:1788463299.482200:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:10549:x1875339395524992:12345-192.168.204.11@tcp:49:lfs.0 Request processed in 300us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463299.482208:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:3.0:1788463299.482411:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b15180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408121088:192.168.204.11@tcp:105: 00010000:00010000:3.0:1788463299.482445:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482456:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3618b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482498:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3624f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482517:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3624f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482533:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3624f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482545:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3624f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482552:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3624f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482589:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3624f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482596:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463299.482601:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3624f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482610:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3624f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482624:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:3.0:1788463299.482627:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463299.482631:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3624f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482648:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3624f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482661:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482667:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36241 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482672:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36241 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482677:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463299.482680:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36241 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482724:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36241 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482733:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:3.0:1788463299.482736:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463299.482739:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36241 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.482745:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36241 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463299.483063:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:10550:x1875339395524736:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 28294us (28703us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788463299.483072:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 127 00000020:00080000:3.0:1788463299.483076:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788463299.483328:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463299.483334:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788463299.483898:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788463299.483910:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788463299.503501:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.503742:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463299.503868:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395525504 00000100:00100000:3.0:1788463299.503879:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395525504 00000100:00100000:3.0:1788463299.503949:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 128 00000100:00100000:3.0:1788463299.503958:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:10549:x1875339395525504:12345-192.168.204.11@tcp:58:lfs.0 00000040:00080000:3.0:1788463299.504379:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788463299.504471:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:10549:x1875339395525504:12345-192.168.204.11@tcp:58:lfs.0 Request processed in 513us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463299.504479:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 128 00000100:00100000:0.0:1788463299.504776:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395525248 00000100:00100000:0.0:1788463299.504786:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395525248 00000100:00100000:0.0:1788463299.504840:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:0.0:1788463299.504851:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05a5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:10550:x1875339395525248:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788463299.505504:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788463299.506052:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788463299.506126:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.506151:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.506165:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.506242:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.506249:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.506255:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.506312:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463299.506317:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463299.506480:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.506489:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc157a4f0) 00000100:00100000:0.0:1788463299.506491:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05a5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:10550:x1875339395525248:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 1637us (2994us total) trans 4294967408 rc 0/0 00010000:00010000:1.0:1788463299.506495:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463299.506501:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 32 00010000:00010000:1.0:1788463299.506503:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788463299.506507:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788463299.506520:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ba5c519a200) 00010000:00010000:1.0:1788463299.506523:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788463299.506537:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.506543:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36256 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463299.506564:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463299.506566:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463299.506568:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463299.583376:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463299.583513:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395525632 00000100:00100000:0.0:1788463299.583525:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395525632 00000100:00100000:0.0:1788463299.583613:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 129 00000100:00100000:0.0:1788463299.583626:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:10552:x1875339395525632:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463299.583666:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463299.583742:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3625d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df65 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.583817:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36264 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.583834:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36264 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.583847:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36264 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.583863:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3626b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.583870:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3626b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.583877:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3626b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.584152:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.584164:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df26 expref: 21 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.584174:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.584215:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df26 expref: 21 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463299.584241:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df26 expref: 21 pid: 8863 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463299.584259:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408121216:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463299.584371:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c4c0f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463299.591462:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463299.592208:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395525888 00000100:00100000:1.0:1788463299.592226:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395525888 00000100:00100000:1.0:1788463299.592319:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:1.0:1788463299.592353:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:5594:x1875339395525888:12345-192.168.204.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788463299.593593:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:5594:x1875339395525888:12345-192.168.204.11@tcp:35:ldlm_bl.0 Request processed in 1240us (2122us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788463299.593605:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:0.0:1788463299.594314:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408121216:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463299.594345:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463299.597500:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463299.598230:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395526016 00000100:00100000:2.0:1788463299.598243:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395526016 00010000:00010000:3.0:1788463299.598452:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df26 expref: 23 pid: 8863 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463299.598535:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:3.0:1788463299.598558:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:2355:x1875339395526016:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463299.598592:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463299.598600:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df26 expref: 23 pid: 8863 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.598616:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df26 expref: 23 pid: 8863 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.598652:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3617d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df26 expref: 23 pid: 8863 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.598671:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:3.0:1788463299.598676:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.598751:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.598760:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463299.598790:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463299.598855:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c8991c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:2355:x1875339395526016:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 297us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463299.598862:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 61 00010000:00010000:2.0:1788463299.598967:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.598976:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463299.599024:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788463299.599027:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463299.599049:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599061:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599070:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36264 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599076:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36264 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599083:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36264 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599096:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463299.599100:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36264 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599109:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36264 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599119:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:2.0:1788463299.599121:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463299.599125:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36264 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599131:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36264 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599143:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3626b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599148:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3626b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599153:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3626b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599158:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463299.599160:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3626b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599165:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3626b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599183:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ba5c519aa00) 00010000:00010000:2.0:1788463299.599186:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463299.599189:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3626b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599195:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3626b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599232:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3625d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df65 expref: 22 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599258:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df65 expref: 21 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463299.599266:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463299.599269:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463299.599271:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f000, rc 0) 00000100:00100000:2.0:1788463299.599298:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:10552:x1875339395525632:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 15675us (15937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463299.599305:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 129 00000100:00100000:2.0:1788463300.140188:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408121344:0@lo:400:kworker.0 00000100:00100000:2.0:1788463300.140281:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463300.140333:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408121856:0@lo:400:kworker.0 00000100:00100000:2.0:1788463300.140360:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463300.140386:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463300.140391:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408121472:0@lo:400:kworker.0 00000100:00100000:2.0:1788463300.140430:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463300.142085:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408121600:0@lo:400:kworker.0 00000100:00100000:0.0:1788463300.142147:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463300.142192:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463300.142199:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408121728:0@lo:400:kworker.0 00000100:00100000:0.0:1788463300.142223:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463300.142268:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408121344 00000100:00100000:0.0:1788463300.142276:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408121344 00000100:00100000:0.0:1788463300.142327:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788463300.142338:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408121344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463300.142402:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408121344:12345-0@lo:400:kworker.0 Request processed in 66us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463300.142409:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788463300.142445:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408121472 00000100:00100000:0.0:1788463300.142450:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408121472 00000100:00100000:0.0:1788463300.142475:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408121600 00000100:00100000:0.0:1788463300.142478:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408121600 00000100:00100000:0.0:1788463300.142523:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408121728 00000100:00100000:0.0:1788463300.142526:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408121728 00000100:00100000:0.0:1788463300.142541:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788463300.142547:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408121472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463300.142591:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408121472:12345-0@lo:400:kworker.0 Request processed in 44us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463300.142597:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788463300.142610:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788463300.142616:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408121600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463300.142648:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408121600:12345-0@lo:400:kworker.0 Request processed in 32us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463300.142653:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788463300.142664:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788463300.142670:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408121728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463300.142717:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408121728:12345-0@lo:400:kworker.0 Request processed in 47us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463300.142722:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788463300.142748:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463300.142786:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408121728:0@lo:400:kworker.0 00000100:00100000:0.0:1788463300.142797:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408121600:0@lo:400:kworker.0 00000100:00100000:0.0:1788463300.142832:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408121472:0@lo:400:kworker.0 00000100:00100000:0.0:1788463300.142842:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408121344:0@lo:400:kworker.0 00000100:00100000:3.0:1788463300.147064:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408121856 00000100:00100000:3.0:1788463300.147086:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408121856 00000100:00100000:3.0:1788463300.147178:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788463300.147192:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408121856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463300.147325:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408121856:12345-0@lo:400:kworker.0 Request processed in 137us (6962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463300.147334:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788463300.149398:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408121856:0@lo:400:kworker.0 00010000:00010000:3.0:1788463300.453643:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788463300.524841:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463300.524858:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788463300.524934:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788463300.524944:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788463300.525124:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ebc8f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408121984:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788463300.525249:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481840 going to sleep for 11 seconds 00000040:00080000:1.0:1788463300.525886:0:12100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463300.525892:0:12100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788463300.525936:0:12100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788463300.525943:0:12100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788463300.531217:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ebc8f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408121984:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788463300.534199:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463300.534378:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395526144 00000100:00100000:0.0:1788463300.534415:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395526144 00000100:00100000:0.0:1788463300.534521:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 130 00000100:00100000:0.0:1788463300.534533:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:10563:x1875339395526144:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788463300.534598:0:8863:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788463300.534758:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:10563:x1875339395526144:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 226us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463300.534767:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 130 00000100:00080000:3.0:1788463300.534898:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463300.552934:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463300.553020:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395526400 00000100:00100000:0.0:1788463300.553035:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395526400 00000100:00100000:0.0:1788463300.553097:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 131 00000100:00100000:0.0:1788463300.553108:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:10563:x1875339395526400:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463300.553129:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463300.553153:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36279 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df6c expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463300.553299:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36280 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463300.553319:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463300.553334:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463300.553349:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788463300.553515:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36279 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df6c expref: 24 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463300.553537:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df6c expref: 23 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463300.553574:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:0.0:1788463300.553578:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463300.553582:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e600, rc 0) 00000100:00100000:0.0:1788463300.553671:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:10563:x1875339395526400:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 564us (753us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788463300.553679:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 131 00000100:00100000:1.0:1788463300.570198:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463300.570281:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463300.570319:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395526528 00000100:00100000:1.0:1788463300.570333:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395526528 00000100:00100000:1.0:1788463300.570426:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:1.0:1788463300.570438:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:2355:x1875339395526528:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463300.570462:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463300.570498:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36280 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df6c expref: 23 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463300.570527:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:1.0:1788463300.570535:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463300.570625:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:2355:x1875339395526528:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 188us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463300.570633:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:3.0:1788463300.584388:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395526784 00000100:00100000:3.0:1788463300.584407:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395526784 00000100:00100000:3.0:1788463300.584494:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 132 00000100:00100000:3.0:1788463300.584507:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:10563:x1875339395526784:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788463300.584633:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3628e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463300.584655:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3628e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463300.584668:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3628e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463300.585679:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3628e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463300.585725:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3628e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463300.585733:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3628e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463300.585739:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463300.585773:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3628e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463300.585784:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3628e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463300.585805:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:3.0:1788463300.585808:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463300.585814:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3628e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463300.585821:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3628e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463300.586076:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:10563:x1875339395526784:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 1566us (15787us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788463300.586089:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 132 00000040:00080000:0.0:1788463300.587855:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463300.587865:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463300.588600:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788463300.588620:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788463300.599659:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463300.600009:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395527040 00000100:00100000:1.0:1788463300.600028:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395527040 00000100:00100000:1.0:1788463300.603178:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:1.0:1788463300.603201:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:10563:x1875339395527040:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788463300.603529:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:10563:x1875339395527040:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 336us (3887us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788463300.603537:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:2.0:1788463300.646318:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463300.646351:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408122112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463300.646450:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463300.646580:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408122112 00000100:00100000:3.0:1788463300.646591:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408122112 00000100:00100000:3.0:1788463300.646656:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788463300.646667:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408122112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463300.646728:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463300.646796:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408122112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463300.646804:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788463300.646869:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408122112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463301.325197:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463301.325255:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463301.325402:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395527168 00000100:00100000:3.0:1788463301.325416:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395527168 00000100:00100000:3.0:1788463301.325515:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 294 00000100:00100000:3.0:1788463301.325526:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395527168:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463301.325628:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395527168:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 105us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463301.325637:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 294 00000100:00100000:0.0:1788463301.326025:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463301.330386:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463301.330673:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395527552 00000100:00100000:3.0:1788463301.330705:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395527552 00000100:00100000:3.0:1788463301.330803:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 149 00000100:00100000:3.0:1788463301.330814:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395527552:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463301.330920:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395527552:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 107us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463301.330927:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 149 00000100:00100000:1.0:1788463301.331342:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395527424 00000100:00100000:1.0:1788463301.331349:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395527424 00000100:00080000:0.0:1788463301.331424:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463301.331430:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463301.333646:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395527296 00000100:00100000:2.0:1788463301.333668:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395527296 00000100:00080000:0.0:1788463301.333912:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463301.334260:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 78 00000100:00100000:2.0:1788463301.334274:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395527424:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463301.334457:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395527424:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 187us (9199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463301.334464:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 78 00000100:00100000:2.0:1788463301.334494:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 79 00000100:00100000:2.0:1788463301.334501:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395527296:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463301.334528:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395527296:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 29us (8506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463301.334535:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 79 00010000:00010000:2.0:1788463301.480726:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788463301.790339:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788463301.790358:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788463301.790364:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:1.0:1788463302.500797:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463302.571143:0:12154:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463302.571155:0:12154:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463302.571234:0:12154:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788463302.571244:0:12154:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788463302.630084:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463302.630093:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788463302.630132:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788463302.630152:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788463302.863338:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463302.863422:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395527808 00000100:00100000:2.0:1788463302.863434:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395527808 00000100:00100000:2.0:1788463302.863539:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 133 00000100:00100000:2.0:1788463302.863552:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:10585:x1875339395527808:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463302.863595:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463302.863631:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36295 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df73 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463302.863782:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee3629c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463302.863798:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee3629c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463302.863810:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee3629c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463302.863821:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788463302.863953:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df73 expref: 27 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463302.863969:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee3629c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df73 expref: 26 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463302.863977:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:2.0:1788463302.863980:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788463302.863984:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39a00, rc 0) 00000100:00100000:2.0:1788463302.864038:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:10585:x1875339395527808:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 489us (722us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788463302.864046:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 133 00000100:00080000:1.0:1788463302.866067:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463302.881228:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463302.883348:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395527936 00000100:00100000:1.0:1788463302.883364:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395527936 00000100:00100000:1.0:1788463302.883435:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 134 00000100:00100000:1.0:1788463302.883446:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:10585:x1875339395527936:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:1.0:1788463302.883536:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463302.883555:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463302.883568:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463302.883607:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463302.883614:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463302.883621:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463302.883627:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463302.883631:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463302.883638:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463302.883650:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:1.0:1788463302.883660:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463302.883666:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463302.883673:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463302.883787:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:10585:x1875339395527936:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 341us (2577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463302.883795:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 134 00000100:00100000:0.0:1788463303.028010:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463303.028330:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395528064 00000100:00100000:2.0:1788463303.028343:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395528064 00000100:00100000:2.0:1788463303.028432:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:2.0:1788463303.028443:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395528064:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:2.0:1788463303.028473:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463303.028495:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013b724d8/0xc3fe72277ee362b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df7a expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788463303.028535:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a99c8c2, atime: 0x6a99c8c2, ctime: 0x6a99c8c2, blocks: 0xb 00010000:00010000:2.0:1788463303.028556:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:2.0:1788463303.028560:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463303.028570:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013b724d8/0xc3fe72277ee362b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df7a expref: 7 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463303.028589:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013b724d8/0xc3fe72277ee362b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df7a expref: 7 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463303.028602:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38e00, rc 0) 00000100:00100000:2.0:1788463303.028662:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2356:x1875339395528064:12345-192.168.204.11@tcp:101:cat.0 Request processed in 222us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463303.028669:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00080000:1.0:1788463303.029466:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463303.035054:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463303.035186:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395528192 00000100:00100000:1.0:1788463303.035200:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395528192 00002000:00100000:1.0:1788463303.035264:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ba5f7d35880 x1875339395528192/t0(0) o3->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:439/0 lens 488/0 e 0 to 0 dl 1788463314 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463303.035276:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5f7d35880 with x1875339395528192 ext(0->4095) 00002000:00010000:1.0:1788463303.035283:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5f7d35880 00000100:00100000:1.0:1788463303.035326:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:1.0:1788463303.035348:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395528192:12345-192.168.204.11@tcp:3:cat.0 00000100:00100000:1.0:1788463303.036308:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395528192:12345-192.168.204.11@tcp:3:cat.0 Request processed in 955us (1260us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788463303.036319:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00002000:00100000:1.0:1788463303.036517:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ba5f7d35880 x1875339395528192/t0(0) o3->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:439/0 lens 488/4536 e 0 to 0 dl 1788463314 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463303.036528:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5f7d35880 with x1875339395528192 ext(0->4095) 00002000:00010000:1.0:1788463303.036534:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5f7d35880 00010000:00010000:1.0:1788463303.525546:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463304.230814:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463304.230834:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408122240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463304.230915:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463304.230987:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408122240 00000100:00100000:3.0:1788463304.230996:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408122240 00000100:00100000:3.0:1788463304.231059:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788463304.231069:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe40b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408122240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463304.231104:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463304.231152:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe40b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408122240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463304.231177:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788463304.231377:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463304.231416:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408122240:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788463304.308253:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:2.0:1788463304.308279:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ba5c4f469c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788463304.308285:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5ebdfff00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5c4f46300 00000020:00080000:2.0:1788463304.308289:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5ebdff300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5ec48f000 00000001:00080000:2.0:1788463304.308314:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:2.0:1788463304.308326:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788463304.308338:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788463304.308447:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788463304.308762:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788463304.549899:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788463304.895442:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788463304.895488:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788463304.895496:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:3.0:1788463305.253164:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408122624:0@lo:400:kworker.0 00000100:00100000:3.0:1788463305.253259:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463305.253330:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788463305.253337:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408122496:0@lo:400:kworker.0 00000100:00100000:3.0:1788463305.253365:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463305.253381:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408123008:0@lo:400:kworker.0 00000100:00100000:3.0:1788463305.253402:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463305.253437:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408122624 00000100:00100000:3.0:1788463305.253445:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408122624 00000100:00100000:3.0:1788463305.253518:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408123008 00000100:00100000:3.0:1788463305.253522:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408123008 00000100:00100000:3.0:1788463305.253554:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788463305.253566:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408122624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463305.253629:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408122624:12345-0@lo:400:kworker.0 Request processed in 65us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463305.253637:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788463305.253655:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788463305.253662:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408123008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463305.253728:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408123008:12345-0@lo:400:kworker.0 Request processed in 66us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463305.253751:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788463305.253774:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463305.253808:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000100:00100000:0.0:1788463305.254068:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408122368:0@lo:400:kworker.0 00000100:00100000:0.0:1788463305.254110:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463305.254141:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408122880:0@lo:400:kworker.0 00000100:00100000:0.0:1788463305.254162:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463305.254192:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463305.254198:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875339408122752:0@lo:400:kworker.0 00000100:00100000:0.0:1788463305.254218:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463305.254246:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408122496 00000100:00100000:0.0:1788463305.254250:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408122496 00000100:00100000:0.0:1788463305.254282:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408122880 00000100:00100000:0.0:1788463305.254285:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408122880 00000100:00100000:0.0:1788463305.254306:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408122752 00000100:00100000:0.0:1788463305.254308:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408122752 00000100:00100000:0.0:1788463305.254323:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788463305.254329:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408122496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463305.254365:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408122496:12345-0@lo:400:kworker.0 Request processed in 35us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463305.254371:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788463305.254385:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788463305.254391:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408122880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463305.254422:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408122880:12345-0@lo:400:kworker.0 Request processed in 32us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463305.254428:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788463305.254440:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788463305.254447:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875339408122752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463305.254492:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875339408122752:12345-0@lo:400:kworker.0 Request processed in 46us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463305.254498:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788463305.254522:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408122368 00000100:00100000:0.0:1788463305.254525:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408122368 00000100:00100000:0.0:1788463305.254550:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788463305.254557:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408122368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463305.254596:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408122368:12345-0@lo:400:kworker.0 Request processed in 40us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463305.254602:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:0.0:1788463305.254640:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463305.254662:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875339408122752:0@lo:400:kworker.0 00000100:00100000:0.0:1788463305.254671:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408122368:0@lo:400:kworker.0 00000100:00100000:0.0:1788463305.254678:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408122880:0@lo:400:kworker.0 00000004:00080000:3.0:1788463305.259092:0:3277:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788463305.259134:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5ec436d80, transno 4294967304 00000100:00100000:3.0:1788463305.259264:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408123008:0@lo:400:kworker.0 00000100:00100000:3.0:1788463305.259303:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788463305.259307:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5ec229500, transno 4294967310 00000004:00080000:3.0:1788463305.259331:0:3277:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788463305.259346:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408122624:0@lo:400:kworker.0 00000100:00100000:3.0:1788463305.259369:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408122496:0@lo:400:kworker.0 00010000:00010000:2.0:1788463305.574441:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463305.765645:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788463305.765681:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463305.765821:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463305.766053:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408123136 00000100:00100000:0.0:1788463305.766065:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408123136 00000100:00100000:0.0:1788463305.766134:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788463305.766146:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408123136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463305.766195:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463305.766254:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408123136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463305.766262:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788463305.766631:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408123136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463306.453008:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463306.453047:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463306.453088:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463306.453113:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463306.453139:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463306.453217:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395528448 00000100:00100000:0.0:1788463306.453229:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395528448 00000100:00100000:0.0:1788463306.453309:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395528832 00000100:00100000:0.0:1788463306.453313:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395528832 00000100:00100000:0.0:1788463306.453340:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 153 00000100:00100000:0.0:1788463306.453351:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2357:x1875339395528448:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463306.453430:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2357:x1875339395528448:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 81us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463306.453437:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 153 00000100:00100000:0.0:1788463306.453468:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 154 00000100:00100000:0.0:1788463306.453491:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2357:x1875339395528832:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463306.453518:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2357:x1875339395528832:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463306.453524:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 154 00000100:00080000:1.0:1788463306.453950:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463306.454367:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395528320 00000100:00100000:2.0:1788463306.454375:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395528320 00000100:00100000:2.0:1788463306.454414:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 296 00000100:00100000:2.0:1788463306.454423:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2357:x1875339395528320:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463306.454747:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2357:x1875339395528320:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 323us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463306.454756:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 296 00000100:00100000:3.0:1788463306.454967:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395528704 00000100:00100000:3.0:1788463306.454974:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395528704 00000100:00100000:3.0:1788463306.455041:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395528576 00000100:00100000:3.0:1788463306.455045:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395528576 00000100:00100000:3.0:1788463306.455071:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 82 00000100:00100000:3.0:1788463306.455079:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395528704:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463306.455115:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395528704:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 38us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463306.455122:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 82 00000100:00100000:3.0:1788463306.455137:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 83 00000100:00100000:3.0:1788463306.455144:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395528576:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463306.455168:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395528576:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 25us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463306.455192:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 83 00000100:00080000:3.0:1788463306.455215:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463306.455219:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788463306.597399:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463307.623795:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463308.651422:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463309.161885:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463309.162102:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395528960 00000100:00100000:0.0:1788463309.162115:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395528960 00000100:00100000:0.0:1788463309.162207:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 135 00000100:00100000:0.0:1788463309.162220:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:10229:x1875339395528960:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1788463309.162607:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463309.164281:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:10229:x1875339395528960:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 Request processed in 2050us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463309.164296:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 135 00000100:00100000:3.0:1788463309.170767:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463309.170930:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395529216 00000100:00100000:1.0:1788463309.170952:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395529216 00000100:00100000:1.0:1788463309.171023:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:1.0:1788463309.171036:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:10229:x1875339395529216:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788463309.171456:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:10229:x1875339395529216:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 423us (714us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788463309.171466:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:0.0:1788463309.349301:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408123264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463309.349377:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463309.352520:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408123264 00000100:00100000:3.0:1788463309.352540:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408123264 00000100:00100000:3.0:1788463309.352618:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788463309.352629:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408123264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463309.352674:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463309.353127:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408123264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 498us (3746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463309.353136:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788463309.353170:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463309.353229:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408123264:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1788463309.409713:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788463309.409752:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788463309.410075:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788463309.410088:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788463309.607217:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463309.607587:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395529344 00000100:00100000:0.0:1788463309.607600:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395529344 00000100:00100000:0.0:1788463309.607723:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 136 00000100:00100000:0.0:1788463309.607746:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:11038:x1875339395529344:12345-192.168.204.11@tcp:101:lsof.0 00010000:00010000:0.0:1788463309.607770:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463309.607793:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee362b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df81 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463309.607868:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463309.607904:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463309.607918:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463309.608132:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788463309.608137:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463309.608180:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463309.608205:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee362b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df81 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463309.608225:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df81 expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463309.608234:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:0.0:1788463309.608237:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463309.608241:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710fa00, rc 0) 00000100:00080000:3.0:1788463309.608376:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463309.608423:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:11038:x1875339395529344:12345-192.168.204.11@tcp:101:lsof.0 Request processed in 689us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463309.608430:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 136 00010000:00010000:2.0:1788463309.671164:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463310.373111:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408123520:0@lo:400:kworker.0 00000100:00100000:1.0:1788463310.373187:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463310.373324:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408123392:0@lo:400:kworker.0 00000100:00100000:2.0:1788463310.373401:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463310.373466:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408123392 00000100:00100000:2.0:1788463310.373473:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408123392 00000100:00100000:2.0:1788463310.373550:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788463310.373566:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408123392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463310.373656:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3279:x1875339408123392:12345-0@lo:400:kworker.0 Request processed in 93us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463310.373669:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788463310.373780:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408123392:0@lo:400:kworker.0 00000100:00100000:0.0:1788463310.373943:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408123520 00000100:00100000:0.0:1788463310.373952:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408123520 00000100:00100000:0.0:1788463310.374038:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788463310.374055:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408123520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463310.374450:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408123648:0@lo:400:kworker.0 00000100:00100000:2.0:1788463310.374487:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463310.374549:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408123648 00000100:00100000:2.0:1788463310.374557:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408123648 00000100:00100000:2.0:1788463310.374612:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463310.374624:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408123648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463310.374719:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408123648:12345-0@lo:400:kworker.0 Request processed in 99us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463310.374727:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788463310.374765:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408123648:0@lo:400:kworker.0 00000100:00100000:0.0:1788463310.376891:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408123520:12345-0@lo:400:kworker.0 Request processed in 2834us (3694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463310.376930:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788463310.382516:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408123520:0@lo:400:kworker.0 00000100:00100000:3.0:1788463310.383935:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788463310.384137:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408123776:0@lo:400:kworker.0 00000100:00100000:0.0:1788463310.384236:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463310.384278:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463310.384291:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408123904:0@lo:400:kworker.0 00000100:00100000:0.0:1788463310.384334:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463310.384404:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408123776 00000100:00100000:0.0:1788463310.384417:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408123776 00000100:00100000:0.0:1788463310.384479:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408123904 00000100:00100000:0.0:1788463310.384483:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408123904 00000100:00100000:0.0:1788463310.384506:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788463310.384515:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408123776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463310.384564:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408123776:12345-0@lo:400:kworker.0 Request processed in 50us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463310.384583:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788463310.384598:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788463310.384604:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408123904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463310.384626:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408123904:12345-0@lo:400:kworker.0 Request processed in 23us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463310.384632:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788463310.384661:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408123904:0@lo:400:kworker.0 00000100:00100000:0.0:1788463310.384669:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408123776:0@lo:400:kworker.0 00000100:00080000:0.0:1788463310.384735:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463310.385080:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408124032:0@lo:400:kworker.0 00000100:00100000:3.0:1788463310.385118:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463310.385215:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408124032 00000100:00100000:2.0:1788463310.385223:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408124032 00000100:00100000:2.0:1788463310.385279:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788463310.385294:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408124032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463310.385361:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408124032:12345-0@lo:400:kworker.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463310.385384:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788463310.385462:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463310.385520:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408124032:0@lo:400:kworker.0 00010000:00010000:1.0:1788463310.696263:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463310.885715:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408124160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463310.885808:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463310.886200:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408124160 00000100:00100000:0.0:1788463310.886223:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408124160 00000100:00100000:0.0:1788463310.886286:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788463310.886296:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408124160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463310.886334:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463310.886412:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408124160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463310.886420:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788463310.886519:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4b17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408124160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463311.568151:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463311.568217:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463311.568319:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395529600 00000100:00100000:1.0:1788463311.568330:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395529600 00000100:00100000:1.0:1788463311.568444:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 158 00000100:00100000:1.0:1788463311.568456:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2356:x1875339395529600:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463311.568570:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2356:x1875339395529600:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 116us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463311.568593:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 158 00000100:00080000:0.0:1788463311.568990:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463311.569119:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395529856 00000100:00100000:3.0:1788463311.569127:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395529856 00000100:00100000:3.0:1788463311.569194:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00100000:3.0:1788463311.569204:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395529856:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463311.569260:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395529856:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 58us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463311.569268:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00080000:0.0:1788463311.569433:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463311.590243:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463311.590318:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463311.590374:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463311.590968:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395529728 00000100:00100000:3.0:1788463311.590987:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395529728 00000100:00100000:3.0:1788463311.591119:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 87 00000100:00100000:3.0:1788463311.591134:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395529728:12345-192.168.204.11@tcp:400:kworker.0 00000100:00080000:0.0:1788463311.591649:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463311.592162:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395529728:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 1025us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463311.592176:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 87 00000100:00100000:1.0:1788463311.592280:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395529984 00000100:00100000:1.0:1788463311.592295:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395529984 00000100:00100000:1.0:1788463311.592389:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 159 00000100:00100000:1.0:1788463311.592399:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2357:x1875339395529984:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463311.592487:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2357:x1875339395529984:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 90us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463311.592494:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 159 00000100:00080000:1.0:1788463311.592530:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463311.592603:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395529472 00000100:00100000:2.0:1788463311.592608:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395529472 00000100:00100000:2.0:1788463311.592647:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 298 00000100:00100000:2.0:1788463311.592654:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2357:x1875339395529472:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463311.592728:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2357:x1875339395529472:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 30us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463311.592734:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 298 00010000:00010000:1.0:1788463311.716894:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463312.741765:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788463312.869223:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463312.869238:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463312.869911:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788463312.869922:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788463313.766189:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788463314.222621:0:12355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:21:53 (1788463313) 00000100:00100000:3.0:1788463314.473620:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408124288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463314.473796:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463314.473891:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408124288 00000100:00100000:3.0:1788463314.473900:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408124288 00000100:00100000:3.0:1788463314.473984:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788463314.473997:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408124288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463314.474047:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463314.474101:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408124288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463314.474109:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788463314.474134:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463314.474176:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408124288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788463314.788907:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463315.494065:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408124672:0@lo:400:kworker.0 00000100:00100000:2.0:1788463315.494169:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463315.494246:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788463315.494252:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408124544:0@lo:400:kworker.0 00000100:00100000:2.0:1788463315.494293:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463315.494313:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408125056:0@lo:400:kworker.0 00000100:00100000:2.0:1788463315.494348:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463315.494586:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408124544 00000100:00100000:1.0:1788463315.494599:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408124544 00000100:00100000:1.0:1788463315.494673:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788463315.494715:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408124544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463315.494802:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408124544:12345-0@lo:400:kworker.0 Request processed in 119us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463315.494809:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788463315.494837:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408124672 00000100:00100000:1.0:1788463315.494840:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408124672 00000100:00100000:1.0:1788463315.494866:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408125056 00000100:00100000:1.0:1788463315.494868:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408125056 00000100:00100000:1.0:1788463315.494903:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788463315.494910:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408124672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463315.494958:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408124672:12345-0@lo:400:kworker.0 Request processed in 37us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463315.494989:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788463315.495002:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788463315.495009:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408125056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463315.495039:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408125056:12345-0@lo:400:kworker.0 Request processed in 32us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463315.495044:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788463315.495089:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408124544:0@lo:400:kworker.0 00000100:00100000:1.0:1788463315.495101:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408125056:0@lo:400:kworker.0 00000100:00100000:1.0:1788463315.495112:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408124672:0@lo:400:kworker.0 00000100:00080000:3.0:1788463315.495357:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463315.495372:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408124800:0@lo:400:kworker.0 00000100:00100000:3.0:1788463315.495408:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463315.495453:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788463315.495461:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408124416:0@lo:400:kworker.0 00000100:00100000:3.0:1788463315.495493:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463315.495519:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408124928:0@lo:400:kworker.0 00000100:00100000:3.0:1788463315.495544:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463315.495573:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408124416 00000100:00100000:3.0:1788463315.495577:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408124416 00000100:00100000:3.0:1788463315.495612:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788463315.495620:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408124416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463315.495661:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408124416:12345-0@lo:400:kworker.0 Request processed in 42us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463315.495668:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788463315.495730:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408124800 00000100:00100000:3.0:1788463315.495734:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408124800 00000100:00100000:3.0:1788463315.495780:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408124928 00000100:00100000:3.0:1788463315.495784:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408124928 00000100:00100000:3.0:1788463315.495810:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788463315.495816:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408124800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463315.495847:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408124800:12345-0@lo:400:kworker.0 Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463315.495854:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788463315.495865:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788463315.495870:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408124928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463315.495909:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408124928:12345-0@lo:400:kworker.0 Request processed in 39us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463315.495917:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1788463315.495940:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463315.496153:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408124416:0@lo:400:kworker.0 00000100:00100000:3.0:1788463315.496166:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408124928:0@lo:400:kworker.0 00000100:00100000:3.0:1788463315.496175:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408124800:0@lo:400:kworker.0 00010000:00010000:1.0:1788463315.813221:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463315.814657:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463315.814762:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395530240 00000100:00100000:1.0:1788463315.814776:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395530240 00000100:00100000:1.0:1788463315.814926:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 137 00000100:00100000:1.0:1788463315.814938:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:11304:x1875339395530240:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463315.814964:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463315.814987:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee362c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df88 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788463315.815049:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463315.815189:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee362cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815205:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee362cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815216:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee362cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815249:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee362d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815256:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee362d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815274:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee362d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815516:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815524:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815531:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463315.815541:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788463315.815721:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee362cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815730:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee362cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815735:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee362cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815740:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463315.815808:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee362cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815826:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee362cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815839:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ba5c5b58700) 00010000:00010000:1.0:1788463315.815842:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463315.815846:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee362cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815852:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee362cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815866:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee362d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815872:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee362d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815877:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee362d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815882:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463315.815885:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee362d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815891:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee362d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815898:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ba5d9430e00) 00010000:00010000:1.0:1788463315.815900:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463315.815902:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee362d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.815917:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee362d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.820538:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee362c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df88 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.820567:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df88 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463315.820576:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:1.0:1788463315.820579:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463315.820585:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488a00, rc 0) 00000100:00100000:1.0:1788463315.821419:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:11304:x1875339395530240:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 6479us (6765us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788463315.821431:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 137 00000100:00100000:0.0:1788463315.829530:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463315.830444:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395530368 00000100:00100000:3.0:1788463315.830458:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395530368 00000100:00100000:3.0:1788463315.830529:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 138 00000100:00100000:3.0:1788463315.830539:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:11304:x1875339395530368:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788463315.830668:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:11304:x1875339395530368:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 Request processed in 130us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463315.830677:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 138 00000100:00100000:2.0:1788463315.835523:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463315.835623:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395530496 00000100:00100000:3.0:1788463315.835635:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395530496 00000100:00100000:3.0:1788463315.835761:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:3.0:1788463315.835774:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:2356:x1875339395530496:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463315.835794:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463315.835826:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee362db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df88 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463315.835851:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:3.0:1788463315.835877:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463315.835929:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:2356:x1875339395530496:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 157us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463315.835937:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000040:00080000:1.0:1788463315.942253:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788463315.942274:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788463315.943007:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788463315.943022:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788463316.009282:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fec58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408125184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463316.009365:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463316.010363:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408125184 00000100:00100000:0.0:1788463316.010377:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408125184 00000100:00100000:0.0:1788463316.010460:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788463316.010472:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408125184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788463316.010524:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463316.010611:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408125184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463316.010618:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788463316.011242:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fec58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408125184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463316.684935:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463316.684990:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463316.685049:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463316.685074:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463316.685113:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463316.685149:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395530752 00000100:00100000:0.0:1788463316.685162:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395530752 00000100:00100000:0.0:1788463316.685237:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395531136 00000100:00100000:0.0:1788463316.685251:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395531136 00000100:00100000:0.0:1788463316.685288:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 163 00000100:00100000:0.0:1788463316.685299:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:2356:x1875339395530752:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463316.685383:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:2356:x1875339395530752:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 85us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463316.685391:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 163 00000100:00100000:0.0:1788463316.685412:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 164 00000100:00100000:0.0:1788463316.685419:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2356:x1875339395531136:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463316.685447:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2356:x1875339395531136:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463316.685452:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 164 00000100:00100000:0.0:1788463316.685498:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395530624 00000100:00100000:0.0:1788463316.685502:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395530624 00000100:00100000:0.0:1788463316.685528:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 300 00000100:00100000:0.0:1788463316.685535:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2356:x1875339395530624:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463316.685560:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2356:x1875339395530624:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463316.685568:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 300 00000100:00080000:2.0:1788463316.685895:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463316.685909:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395531008 00000100:00100000:2.0:1788463316.685913:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395531008 00000100:00100000:2.0:1788463316.685945:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395530880 00000100:00100000:2.0:1788463316.685948:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395530880 00000100:00100000:2.0:1788463316.685971:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 90 00000100:00100000:2.0:1788463316.685980:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395531008:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463316.686018:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2356:x1875339395531008:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 40us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463316.686025:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 90 00000100:00100000:2.0:1788463316.686039:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 91 00000100:00100000:2.0:1788463316.686045:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395530880:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463316.686075:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2356:x1875339395530880:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 24us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463316.686082:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 91 00000100:00080000:2.0:1788463316.686134:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463316.686137:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788463316.838568:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463317.862296:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463318.102628:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.102958:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395531264 00000100:00100000:2.0:1788463318.102973:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395531264 00000100:00100000:2.0:1788463318.103237:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 139 00000100:00100000:2.0:1788463318.103252:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:11347:x1875339395531264:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463318.103274:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463318.103297:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee362e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df8f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.103368:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee362f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.103385:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee362f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.103400:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee362f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.103416:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee362f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.103424:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee362f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.103431:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee362f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788463318.103507:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788463318.105359:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee362f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.105382:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee362f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.105400:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee362f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.105407:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463318.105414:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee362f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.105425:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee362f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.105448:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:2.0:1788463318.105452:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463318.105459:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee362f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107136:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee362f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107185:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee362f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107195:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee362f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107205:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee362f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107213:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463318.107252:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee362f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107277:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee362f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107300:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ba5d0c1e600) 00010000:00010000:2.0:1788463318.107303:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463318.107309:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee362f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107317:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee362f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107395:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee362e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df8f expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107407:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:2.0:1788463318.107410:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463318.107414:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee362e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df8f expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.107425:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39e00, rc 0) 00000100:00100000:2.0:1788463318.107561:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:11347:x1875339395531264:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 4311us (4949us total) trans 0 rc 301/301 00000100:00100000:2.0:1788463318.107574:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 139 00000100:00100000:2.0:1788463318.114843:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463318.119184:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395531520 00000100:00100000:1.0:1788463318.119211:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395531520 00000100:00100000:1.0:1788463318.119467:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 140 00000100:00100000:1.0:1788463318.119494:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:11347:x1875339395531520:12345-192.168.204.11@tcp:36:lfs.0 00010000:00010000:1.0:1788463318.119569:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463318.119606:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee35c67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddc8 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.119628:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:1.0:1788463318.119634:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463318.120149:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.120169:0:8863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df81 expref: 5 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.120179:0:8863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.120230:0:8863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df81 expref: 5 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.120245:0:8863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df81 expref: 5 pid: 5816 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463318.120261:0:8863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5614e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408125312:192.168.204.11@tcp:104: 00000100:00100000:1.0:1788463318.120394:0:8863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7d400c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463318.127817:0:8863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5614e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408125312:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463318.127856:0:8863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463318.135604:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463318.135676:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395531648 00000100:00100000:1.0:1788463318.135712:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395531648 00000100:00080000:2.0:1788463318.135775:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463318.135779:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df81 expref: 6 pid: 5816 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463318.135834:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:1.0:1788463318.135846:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2354:x1875339395531648:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463318.135865:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463318.135874:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df81 expref: 6 pid: 5816 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.135889:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df81 expref: 6 pid: 5816 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.135926:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee362bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df81 expref: 6 pid: 5816 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.135945:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:1.0:1788463318.135951:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.135961:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.135969:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.136005:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463318.136075:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2354:x1875339395531648:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 230us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463318.136090:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 62 00010000:00010000:1.0:1788463318.150806:0:8863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.150824:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.150864:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.150878:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.150889:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463318.161368:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788463318.161780:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.161793:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.161802:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.161807:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463318.161813:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.161823:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.161855:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c5b58800) 00010000:00010000:1.0:1788463318.161859:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463318.161865:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.161873:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee362fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463318.161899:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000881ab294 reply state 00000000739e1eb1 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463318.161912:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463318.162075:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:11347:x1875339395531520:12345-192.168.204.11@tcp:36:lfs.0 Request processed in 42581us (47243us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788463318.162086:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 140 00010000:00010000:3.0:1788463318.173489:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.173517:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.173526:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.173533:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463318.173540:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.173549:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.173573:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ba5d9430e00) 00010000:00010000:3.0:1788463318.173576:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463318.173583:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.173590:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36305 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463318.263089:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463318.263272:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395531776 00000100:00100000:1.0:1788463318.263283:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395531776 00000100:00100000:1.0:1788463318.263342:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 141 00000100:00100000:1.0:1788463318.263353:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:11355:x1875339395531776:12345-192.168.204.11@tcp:101:lctl.0 00010000:00010000:1.0:1788463318.263406:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463318.263438:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3630c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df96 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.263527:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36313 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.263544:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.263590:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463318.263634:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788463318.263638:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463318.263675:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36313 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.263725:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3630c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df96 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.263745:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36313 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df96 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.263754:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:1.0:1788463318.263757:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463318.263760:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488600, rc 0) 00000100:00100000:1.0:1788463318.263823:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:11355:x1875339395531776:12345-192.168.204.11@tcp:101:lctl.0 Request processed in 473us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463318.263829:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 141 00000100:00100000:1.0:1788463318.326815:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.326881:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395531904 00000100:00100000:2.0:1788463318.326892:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395531904 00000100:00100000:3.0:1788463318.327061:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 142 00000100:00100000:3.0:1788463318.327079:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+15:11361:x1875339395531904:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:3.0:1788463318.327104:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463318.327127:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3631a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51df9d expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327194:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36321 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327208:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36321 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327233:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36321 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327251:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36328 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327259:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327267:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327370:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee3632f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327507:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee3632f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327515:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee3632f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463318.327783:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788463318.327788:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463318.327814:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee3632f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327828:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36321 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327836:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36321 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327845:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36321 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327852:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463318.327858:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36321 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327867:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36321 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327880:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:3.0:1788463318.327882:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463318.327887:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327894:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327909:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36328 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327925:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36328 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327932:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36328 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327937:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463318.327941:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36328 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327947:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36328 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327956:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ba5d0217500) 00010000:00010000:3.0:1788463318.327958:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463318.327961:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36328 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.327967:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36328 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.328004:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee3631a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df9d expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.328018:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee3632f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df9d expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.328026:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:3.0:1788463318.328028:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788463318.328036:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0800, rc 0) 00000100:00100000:3.0:1788463318.328124:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:11361:x1875339395531904:12345-192.168.204.11@tcp:101:bash.0 Request processed in 1041us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463318.328134:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 142 00000100:00100000:1.0:1788463318.340653:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.342634:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395532160 00000100:00100000:2.0:1788463318.342653:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395532160 00000100:00100000:2.0:1788463318.342776:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 143 00000100:00100000:2.0:1788463318.342789:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:11361:x1875339395532160:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1788463318.342814:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463318.342842:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36336 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfa4 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.342998:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3633d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.343016:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3633d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.343030:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3633d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.343101:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.343110:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.343117:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788463318.344004:0:8863:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788463318.344173:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.344184:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.344200:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.344249:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3633d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.344258:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3633d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.345877:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3633d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.345885:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463318.345890:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3633d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.345901:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3633d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.345920:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:2.0:1788463318.345923:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463318.345928:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3633d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.345934:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38400/0xc3fe72277ee3633d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463318.345957:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a60cd382 reply state 000000006a9c732d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463318.345967:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788463318.346050:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee36336 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfa4 expref: 19 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.346066:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfa4 expref: 18 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.346072:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e500) 00010000:00010000:2.0:1788463318.346075:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463318.346077:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38000, rc 0) 00000100:00100000:2.0:1788463318.346176:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11361:x1875339395532160:12345-192.168.204.11@tcp:101:bash.0 Request processed in 3388us (5540us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788463318.346186:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 143 00010000:00010000:1.0:1788463318.356873:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.356896:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.356904:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.356928:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463318.356934:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.356945:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.356967:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d0c1e600) 00010000:00010000:1.0:1788463318.356970:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463318.356976:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.356983:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36344 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463318.361389:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.361494:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395532288 00000100:00100000:2.0:1788463318.361506:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395532288 00000100:00100000:2.0:1788463318.361598:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:2.0:1788463318.361608:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395532288:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1788463318.361626:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463318.361649:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000139dff75/0xc3fe72277ee36359 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfab expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788463318.361720:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788463318.361741:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788463318.361746:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463318.361756:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000139dff75/0xc3fe72277ee36359 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfab expref: 6 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.361777:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000139dff75/0xc3fe72277ee36359 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfab expref: 6 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.361807:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38a00, rc 0) 00000100:00100000:2.0:1788463318.361864:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395532288:12345-192.168.204.11@tcp:101:bash.0 Request processed in 257us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.361872:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00080000:3.0:1788463318.361951:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788463318.369151:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.369295:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395532416 00000100:00100000:2.0:1788463318.369310:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395532416 00000100:00100000:2.0:1788463318.369379:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:2.0:1788463318.369392:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:11361:x1875339395532416:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1788463318.369418:0:8660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463318.369440:0:8660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfb2 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.369481:0:8660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000139dff75/0xc3fe72277ee36359 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfab expref: 7 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.369492:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463318.369496:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463318.369502:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 7 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.369552:0:8660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000139dff75/0xc3fe72277ee36359 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfab expref: 7 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.369569:0:8660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000139dff75/0xc3fe72277ee36359 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfab expref: 7 pid: 6668 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463318.369603:0:8660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec487800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8660:1875339408125440:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463318.369762:0:8660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c79a36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463318.374466:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463318.374855:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395532544 00000100:00100000:3.0:1788463318.374866:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395532544 00000100:00100000:2.0:1788463318.374912:0:8660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec487800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8660:1875339408125440:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463318.374913:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000139dff75/0xc3fe72277ee36359 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfab expref: 8 pid: 6668 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.374944:0:8660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 8 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.374964:0:8660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38400, rc 0) 00000100:00100000:3.0:1788463318.375075:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:3.0:1788463318.375087:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395532544:12345-192.168.204.11@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788463318.375097:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:11361:x1875339395532416:12345-192.168.204.11@tcp:101:bash.0 Request processed in 5709us (5957us total) trans 0 rc 0/0 00010000:00010000:3.0:1788463318.375103:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788463318.375105:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 49 00010000:00010000:3.0:1788463318.375128:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000139dff75/0xc3fe72277ee36359 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfab expref: 7 pid: 6668 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.375142:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000139dff75/0xc3fe72277ee36359 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfab expref: 7 pid: 6668 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.375171:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000139dff75/0xc3fe72277ee36359 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfab expref: 7 pid: 6668 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.375189:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463318.375193:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463318.375203:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 6 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.375250:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 6 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.375287:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 6 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463318.375302:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5803:1875339408125568:192.168.204.11@tcp:105: 00000100:00100000:3.0:1788463318.375362:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c2ed86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463318.381589:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463318.382154:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5803:1875339408125568:192.168.204.11@tcp:105: 00010000:00010000:3.0:1788463318.382180:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463318.382357:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2354:x1875339395532544:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 7271us (7912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463318.382368:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:2.0:1788463318.382413:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395532800 00000100:00100000:2.0:1788463318.382421:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395532800 00000100:00100000:2.0:1788463318.382469:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:2.0:1788463318.382478:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:11361:x1875339395532800:12345-192.168.204.11@tcp:35:bash.0 00000100:00100000:2.0:1788463318.382828:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11361:x1875339395532800:12345-192.168.204.11@tcp:35:bash.0 Request processed in 350us (1249us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788463318.382836:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:0.0:1788463318.483237:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463318.483315:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395533056 00000100:00100000:3.0:1788463318.483329:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395533056 00000100:00100000:3.0:1788463318.483406:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 144 00000100:00100000:3.0:1788463318.483418:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11371:x1875339395533056:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463318.483449:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463318.483477:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36367 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfb9 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463318.483600:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788463318.483814:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36367 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb9 expref: 21 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.483855:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:3.0:1788463318.483859:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463318.483866:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36367 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb9 expref: 21 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.483885:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0600, rc 0) 00000100:00100000:3.0:1788463318.483969:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:11371:x1875339395533056:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 552us (757us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788463318.483978:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 144 00000100:00100000:1.0:1788463318.488847:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463318.488917:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395533312 00000100:00100000:3.0:1788463318.488928:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395533312 00000100:00100000:3.0:1788463318.488985:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:3.0:1788463318.488995:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:11371:x1875339395533312:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463318.489268:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:11371:x1875339395533312:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 274us (430us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788463318.489276:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:1.0:1788463318.564430:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.564543:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395533440 00000100:00100000:2.0:1788463318.564569:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395533440 00000100:00100000:2.0:1788463318.564639:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 145 00000100:00100000:2.0:1788463318.564659:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:11377:x1875339395533440:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463318.564897:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463318.564920:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36375 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfc0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.565050:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3637c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.565069:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3637c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.565085:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3637c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463318.565125:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788463318.565129:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463318.565148:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3637c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.565178:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfc0 expref: 23 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.565198:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3637c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfc0 expref: 22 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.565221:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:2.0:1788463318.565224:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463318.565228:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38a00, rc 0) 00000100:00100000:2.0:1788463318.565497:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:11377:x1875339395533440:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 840us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.565505:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 145 00000100:00100000:0.0:1788463318.571600:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.571789:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395533696 00000100:00100000:2.0:1788463318.571798:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395533696 00000100:00100000:2.0:1788463318.571864:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 146 00000100:00100000:2.0:1788463318.571874:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:11377:x1875339395533696:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463318.571894:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463318.571913:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36383 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfc7 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.572001:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee3638a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.572014:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee3638a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.572026:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee3638a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463318.572036:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788463318.572143:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36383 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfc7 expref: 25 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.572160:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee3638a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfc7 expref: 24 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.572169:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e500) 00010000:00010000:2.0:1788463318.572172:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463318.572175:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38800, rc 0) 00000100:00100000:2.0:1788463318.572241:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11377:x1875339395533696:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 369us (649us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788463318.572248:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 146 00000100:00100000:3.0:1788463318.578531:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463318.578625:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463318.578965:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395534080 00000100:00100000:1.0:1788463318.578978:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395534080 00000100:00100000:1.0:1788463318.579054:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:1.0:1788463318.579064:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:2354:x1875339395534080:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463318.579083:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463318.579110:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee3638a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfc7 expref: 24 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.579162:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e500) 00010000:00010000:1.0:1788463318.579168:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463318.579248:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:2354:x1875339395534080:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 185us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463318.579256:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:2.0:1788463318.580775:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395533952 00000100:00100000:2.0:1788463318.580810:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395533952 00000100:00100000:2.0:1788463318.580909:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 147 00000100:00100000:2.0:1788463318.580922:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:11377:x1875339395533952:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463318.580971:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463318.580995:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36398 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfce expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.581135:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3639f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.581151:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3639f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.581162:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3639f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463318.581175:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788463318.581331:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36398 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfce expref: 26 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.581349:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3639f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfce expref: 25 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.581359:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e500) 00010000:00010000:2.0:1788463318.581363:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788463318.581365:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39c00, rc 0) 00000100:00100000:2.0:1788463318.582078:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+25:11377:x1875339395533952:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1151us (3553us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788463318.582088:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 147 00000100:00100000:0.0:1788463318.587445:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.587503:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395534208 00000100:00100000:2.0:1788463318.587514:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395534208 00000100:00100000:2.0:1788463318.587589:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:2.0:1788463318.587603:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395534208:12345-192.168.204.11@tcp:1:lfs.0 00010000:00010000:2.0:1788463318.587669:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.587719:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 6 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.587730:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788463318.587735:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463318.587740:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.587784:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 6 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.587800:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 6 pid: 8660 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463318.587816:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec487800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6668:1875339408125696:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463318.588236:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c79a36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463318.593085:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463318.593169:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395534336 00000100:00100000:3.0:1788463318.593178:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395534336 00002000:00100000:3.0:1788463318.593243:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ba5c5bead80 x1875339395534336/t0(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:454/0 lens 504/0 e 0 to 0 dl 1788463329 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463318.593255:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5c5bead80 with x1875339395534336 ext(0->12) 00010000:00010000:3.0:1788463318.593265:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 7 pid: 8660 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.593308:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 7 pid: 8660 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463318.593316:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ba5c5bead80 00000100:00100000:3.0:1788463318.593349:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:3.0:1788463318.593358:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395534336:12345-192.168.204.11@tcp:4:lfs.0 00000100:00100000:3.0:1788463318.593975:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5bead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2355:x1875339395534336:12345-192.168.204.11@tcp:4:lfs.0 Request processed in 611us (893us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788463318.593984:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00002000:00100000:3.0:1788463318.593994:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ba5c5bead80 x1875339395534336/t4294967305(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:454/0 lens 504/448 e 0 to 0 dl 1788463329 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788463318.594004:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5c5bead80 with x1875339395534336 ext(0->12) 00010000:00010000:3.0:1788463318.594011:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 9 pid: 8660 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.594026:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 9 pid: 8660 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788463318.594034:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ba5c5bead80 00000100:00100000:2.0:1788463318.595488:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec487800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6668:1875339408125696:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463318.595528:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463318.597926:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463318.598188:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395534464 00000100:00100000:1.0:1788463318.598201:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395534464 00010000:00010000:1.0:1788463318.598271:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 9 pid: 8660 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463318.598325:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 64 00000100:00100000:1.0:1788463318.598338:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2354:x1875339395534464:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463318.598359:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788463318.598381:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788463318.598385:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788463318 00002000:00010000:1.0:1788463318.598387:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788463319 00002000:00010000:1.0:1788463318.598389:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788463318 00010000:00010000:1.0:1788463318.598396:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 9 pid: 8660 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.598411:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 9 pid: 8660 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.598441:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084a2e3c1/0xc3fe72277ee36360 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfb2 expref: 9 pid: 8660 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.598484:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463318.598489:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463318.598496:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.598506:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.598598:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463318.598738:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395534464:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 346us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463318.598747:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 64 00010000:00010000:2.0:1788463318.599347:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.599360:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.599389:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.599397:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.599405:0:6668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.599413:0:6668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38c00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463318.599417:0:6668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.599427:0:6668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.599440:0:6668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.599462:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000551c01ba/0xc3fe72277ee363ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463318.599542:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395534208:12345-192.168.204.11@tcp:1:lfs.0 Request processed in 11940us (12107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.599551:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:3.0:1788463318.602541:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463318.602805:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395534720 00000100:00100000:1.0:1788463318.602821:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395534720 00000100:00100000:1.0:1788463318.602892:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:1.0:1788463318.602902:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05a4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+25:11377:x1875339395534720:12345-192.168.204.11@tcp:35:lfs.0 00000004:00010000:1.0:1788463318.602984:0:5819:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3639f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfce expref: 25 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463318.603268:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788463318.603316:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788463318.604468:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788463318.604550:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.604652:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfa4 expref: 29 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.604672:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.604746:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfa4 expref: 29 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.604762:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfa4 expref: 29 pid: 8863 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463318.604776:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec435180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5819:1875339408125824:192.168.204.11@tcp:104: 00000100:00100000:1.0:1788463318.604938:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7d400c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463318.608161:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec435180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5819:1875339408125824:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463318.608290:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463318.610652:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463318.615909:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395534848 00000100:00100000:1.0:1788463318.615925:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395534848 00010000:00010000:1.0:1788463318.615988:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfa4 expref: 30 pid: 8863 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463318.616026:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 65 00000100:00100000:1.0:1788463318.616035:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:2355:x1875339395534848:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463318.616049:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463318.616055:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfa4 expref: 30 pid: 8863 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.616069:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfa4 expref: 30 pid: 8863 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.616092:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3634b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfa4 expref: 30 pid: 8863 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.616127:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e500) 00010000:00010000:1.0:1788463318.616132:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.616445:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.616454:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.616488:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463318.616778:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:2355:x1875339395534848:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 742us (6136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463318.616786:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 65 00010000:00010000:3.0:1788463318.616890:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.616898:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463318.617026:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788463318.617238:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788463318.617343:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408125952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788463318.617393:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463318.617434:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c2ed8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788463318.617871:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408125952 00000100:00100000:1.0:1788463318.617879:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408125952 00000100:00100000:1.0:1788463318.617923:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463318.617930:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1875339408125952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788463318.618006:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1875339408125952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463318.618013:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788463318.618085:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463318.618116:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408125952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788463318.618969:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788463318.619045:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408126080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788463318.619089:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463318.619113:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49180 going to sleep for 11 seconds 00000100:00100000:1.0:1788463318.619382:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408126080 00000100:00100000:1.0:1788463318.619389:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408126080 00000100:00100000:1.0:1788463318.619434:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463318.619443:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1875339408126080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788463318.619616:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5819:x1875339408126080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 174us (526us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788463318.619635:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463318.620349:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408126080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788463318.620414:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788463318.620458:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.620468:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.620476:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.620490:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463318.620494:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.620503:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.620519:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e500) 00010000:00010000:3.0:1788463318.620522:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788463318.620528:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463318.620533:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788463318.623528:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788463318.629030:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788463318.629058:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350239372612ns, next at 351239366782ns, rc = 0 00000001:00080000:3.0:1788463318.629079:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788463318.629189:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e500) 00010000:00010000:3.0:1788463318.629195:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788463318.629222:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee3639f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfce expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463318.629421:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05a4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11377:x1875339395534720:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 26517us (26891us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788463318.629435:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 38 00000020:00080000:3.0:1788463318.629442:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788463318.632271:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.634040:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395534976 00000100:00100000:2.0:1788463318.634060:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395534976 00000100:00100000:2.0:1788463318.634179:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 148 00000100:00100000:2.0:1788463318.634193:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11377:x1875339395534976:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463318.634240:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463318.634270:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee363bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfd5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.634361:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee363bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfd5 expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.634380:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee363bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfd5 expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.634406:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463318.634410:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788463318.634416:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39600, rc 0) 00000100:00100000:2.0:1788463318.634523:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:11377:x1875339395534976:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 332us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.634567:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 148 00000100:00100000:1.0:1788463318.640624:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.640796:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395535232 00000100:00100000:2.0:1788463318.640808:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395535232 00000100:00100000:2.0:1788463318.640877:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:2.0:1788463318.640890:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:11377:x1875339395535232:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:2.0:1788463318.641193:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:11377:x1875339395535232:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 304us (579us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788463318.641201:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:3.0:1788463318.736331:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463318.736457:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395535488 00000100:00100000:0.0:1788463318.736469:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395535488 00000100:00100000:0.0:1788463318.736538:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 149 00000100:00100000:0.0:1788463318.736549:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:11387:x1875339395535488:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463318.736586:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463318.736610:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee363c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfdc expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463318.736967:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788463318.737110:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee363c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfdc expref: 36 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.737127:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:2.0:1788463318.737130:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463318.737135:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee363c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfdc expref: 36 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.737150:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e600, rc 0) 00000100:00100000:2.0:1788463318.737217:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:11387:x1875339395535488:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 670us (897us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788463318.737225:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 149 00000100:00100000:1.0:1788463318.744749:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.746075:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395535616 00000100:00100000:2.0:1788463318.746091:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395535616 00000100:00100000:2.0:1788463318.746237:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 150 00000100:00100000:2.0:1788463318.746250:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:11387:x1875339395535616:12345-192.168.204.11@tcp:34:lfs.0 00010000:00010000:2.0:1788463318.746338:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee363d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.746370:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee363d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.746392:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee363d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.746410:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee363d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.746416:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee363d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.746422:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee363d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.746533:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747058:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747068:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463318.747116:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747132:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee363d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747139:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee363d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747160:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee363d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747168:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463318.747172:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee363d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747181:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee363d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747193:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:2.0:1788463318.747196:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463318.747201:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee363d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747220:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee363d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747235:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee363d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747241:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee363d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747247:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee363d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747251:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463318.747254:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee363d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747270:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee363d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747279:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d0c1eb00) 00010000:00010000:2.0:1788463318.747281:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463318.747284:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee363d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747290:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee363d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747306:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747313:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747318:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747322:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463318.747325:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747331:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747337:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463318.747340:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463318.747342:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.747356:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee363de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463318.747476:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:11387:x1875339395535616:12345-192.168.204.11@tcp:34:lfs.0 Request processed in 1225us (2736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.747485:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 150 00000100:00100000:1.0:1788463318.752104:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.752246:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395535872 00000100:00100000:2.0:1788463318.752258:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395535872 00000100:00100000:2.0:1788463318.752327:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:2.0:1788463318.752337:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:11387:x1875339395535872:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:2.0:1788463318.752741:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+36:11387:x1875339395535872:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 404us (648us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788463318.752750:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:0.0:1788463318.809341:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463318.809534:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395536128 00000100:00100000:1.0:1788463318.809545:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395536128 00000100:00100000:1.0:1788463318.809675:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 151 00000100:00100000:1.0:1788463318.809821:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+36:11390:x1875339395536128:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463318.809845:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463318.809866:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee363e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfe3 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.810732:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.810755:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.810770:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.810793:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee363f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.810801:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee363f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.810807:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee363f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811132:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811144:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811152:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463318.811164:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788463318.811300:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811308:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811315:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811321:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463318.811325:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811332:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811344:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463318.811346:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463318.811351:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811372:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee363ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811387:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee363f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811393:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee363f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811399:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee363f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811404:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463318.811407:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee363f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811413:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee363f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811421:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d9430500) 00010000:00010000:1.0:1788463318.811423:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463318.811426:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee363f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811432:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee363f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811480:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee363e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfe3 expref: 39 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811492:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfe3 expref: 38 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463318.811505:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:1.0:1788463318.811508:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463318.811511:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489e00, rc 0) 00000100:00100000:1.0:1788463318.811596:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:11390:x1875339395536128:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1911us (2263us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788463318.811605:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 151 00000100:00100000:1.0:1788463318.816997:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.817196:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395536256 00000100:00100000:2.0:1788463318.817265:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395536256 00000100:00100000:2.0:1788463318.817330:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 152 00000100:00100000:2.0:1788463318.817340:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:11390:x1875339395536256:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:2.0:1788463318.817412:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36408 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.817428:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.817441:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.817469:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.817602:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36408 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.817611:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.817619:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463318.817625:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.817635:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36408 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.817651:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463318.817654:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463318.817659:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36408 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463318.817666:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36408 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463318.817829:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:11390:x1875339395536256:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 489us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463318.817837:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 152 00000100:00100000:3.0:1788463318.821060:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463318.821820:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395536512 00000100:00100000:2.0:1788463318.821832:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395536512 00000100:00100000:2.0:1788463318.822679:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:2.0:1788463318.822747:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:11390:x1875339395536512:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:2.0:1788463318.823326:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+39:11390:x1875339395536512:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 584us (2274us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788463318.823354:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 41 00010000:00010000:1.0:1788463318.884859:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463319.147618:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463319.147787:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395536768 00000100:00100000:2.0:1788463319.147799:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395536768 00000100:00100000:2.0:1788463319.147874:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 153 00000100:00100000:2.0:1788463319.147887:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+39:11421:x1875339395536768:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:2.0:1788463319.147917:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463319.147941:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3640f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfea expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.148053:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee36416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.148069:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee36416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.148082:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee36416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463319.148097:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788463319.148263:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3640f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfea expref: 42 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.148284:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee36416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfea expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.148294:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463319.148297:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463319.148301:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38200, rc 0) 00000100:00100000:2.0:1788463319.148403:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+41:11421:x1875339395536768:12345-192.168.204.11@tcp:101:cat.0 Request processed in 518us (794us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788463319.148411:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 153 00000100:00100000:1.0:1788463319.159801:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463319.159870:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463319.159995:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395537152 00000100:00100000:2.0:1788463319.160009:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395537152 00000100:00100000:2.0:1788463319.160102:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:2.0:1788463319.160113:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+41:2355:x1875339395537152:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463319.160130:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463319.160163:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee36416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfea expref: 41 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.160190:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463319.160208:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463319.160274:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+40:2355:x1875339395537152:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 162us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463319.160282:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:2.0:1788463319.160867:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395537024 00000100:00100000:2.0:1788463319.160874:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395537024 00000100:00100000:2.0:1788463319.160905:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:2.0:1788463319.160913:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+40:11421:x1875339395537024:12345-192.168.204.11@tcp:35:cat.0 00000100:00100000:2.0:1788463319.164895:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+41:11421:x1875339395537024:12345-192.168.204.11@tcp:35:cat.0 Request processed in 3966us (5111us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788463319.164911:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:1.0:1788463319.274907:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463319.275018:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395537408 00000100:00100000:2.0:1788463319.275032:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395537408 00000100:00100000:2.0:1788463319.275117:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 154 00000100:00100000:2.0:1788463319.275128:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+41:11427:x1875339395537408:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:2.0:1788463319.275176:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463319.275180:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788463319.275229:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3637c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfc0 expref: 41 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.275252:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:2.0:1788463319.275258:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463319.275271:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee36424 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dff1 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.275387:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.275405:0:8863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfe3 expref: 41 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.275414:0:8863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.275469:0:8863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfe3 expref: 41 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.275485:0:8863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfe3 expref: 41 pid: 8863 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463319.275502:0:8863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec487800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408126208:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463319.275886:0:8863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c79a3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463319.278381:0:8863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec487800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408126208:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463319.278455:0:8863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463319.279232:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463319.279328:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395537536 00000100:00100000:0.0:1788463319.279337:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395537536 00010000:00010000:0.0:1788463319.279396:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfe3 expref: 42 pid: 8863 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463319.279879:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 66 00000100:00100000:0.0:1788463319.279892:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+42:2355:x1875339395537536:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463319.279908:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463319.279916:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfe3 expref: 42 pid: 8863 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.279996:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfe3 expref: 42 pid: 8863 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.280042:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee363fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfe3 expref: 42 pid: 8863 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.280063:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:0.0:1788463319.280069:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.280080:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.280090:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.280170:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463319.280249:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+41:2355:x1875339395537536:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 360us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463319.280258:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 66 00010000:00010000:2.0:1788463319.282239:0:8863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.282254:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463319.282279:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788463319.283030:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38200/0xc3fe72277ee36424 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff1 expref: 42 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.283063:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff1 expref: 41 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.283073:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463319.283076:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463319.283080:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39200, rc 0) 00000100:00100000:2.0:1788463319.283259:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+41:11427:x1875339395537408:12345-192.168.204.11@tcp:101:dd.0 Request processed in 8131us (8363us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788463319.283269:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 154 00000100:00100000:3.0:1788463319.290348:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463319.291794:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395537792 00000100:00100000:0.0:1788463319.291811:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395537792 00000100:00100000:0.0:1788463319.291929:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 155 00000100:00100000:0.0:1788463319.291942:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+41:11427:x1875339395537792:12345-192.168.204.11@tcp:36:dd.0 00010000:00010000:0.0:1788463319.292320:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.292345:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.292363:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463319.293698:0:8864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788463319.293782:0:8864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec892691 reply state 00000000d7066a8f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463319.293798:0:8864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788463319.293956:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+44:11427:x1875339395537792:12345-192.168.204.11@tcp:36:dd.0 Request processed in 2013us (3618us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788463319.293966:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 155 00000020:00080000:0.0:1788463319.293971:0:8864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788463319.300577:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.300610:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.300620:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.300628:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463319.300635:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.300645:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.300668:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:0.0:1788463319.300671:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463319.300678:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.300707:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36439 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463319.592745:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408126336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463319.592825:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463319.593054:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408126336 00000100:00100000:0.0:1788463319.593063:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408126336 00000100:00100000:0.0:1788463319.593141:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788463319.593155:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408126336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788463319.593206:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463319.593261:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408126336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463319.593268:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788463319.593441:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463319.593482:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408126336:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788463319.649121:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000004:00080000:0.0:1788463319.649181:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788463319.649219:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ba5c2ed8540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788463319.649225:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c9078d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5c2ed8cc0 00000020:00080000:0.0:1788463319.649228:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5ebdff200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5fedee400 00000020:00080000:0.0:1788463319.649260:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788463319.649444:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788463319.649606:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463319.649623:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408126464:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788463319.649716:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463319.649869:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408126464 00000100:00100000:0.0:1788463319.649894:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408126464 00000100:00100000:0.0:1788463319.649961:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788463319.649971:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875339408126464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788463319.649998:0:6665:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1788463319.650035:0:6665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a99c8d6, atime: 0x6a99c8d7, ctime: 0x6a99c8d6, blocks: 0x1 00010000:00010000:0.0:1788463319.650043:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef80c070/0xc3fe72277ee36440 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.650061:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1788463319.650079:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463319.650087:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef80c070/0xc3fe72277ee36440 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.650108:0:6665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef80c070/0xc3fe72277ee36440 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.650118:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef80c070/0xc3fe72277ee36440 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.650126:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef80c070/0xc3fe72277ee36440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.650144:0:6665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788463319.651343:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3278:x1875339408126464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1369us (1622us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788463319.651353:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:0.0:1788463319.651382:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463319.651389:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef80c070/0xc3fe72277ee36440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.651399:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463319.651404:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef80c070/0xc3fe72277ee36440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.651414:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef80c070/0xc3fe72277ee36440 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.651446:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef80c070/0xc3fe72277ee36440 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.651454:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef80c070/0xc3fe72277ee36440 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.651473:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463319.651475:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463319.651477:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788463319.651952:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5fe9c8a80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788463319.651960:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408126464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788463319.723989:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463319.728644:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395537920 00000100:00100000:0.0:1788463319.728666:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395537920 00000100:00100000:0.0:1788463319.728787:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 156 00000100:00100000:0.0:1788463319.728800:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+16:11440:x1875339395537920:12345-192.168.204.11@tcp:101:stat.0 00010000:00010000:0.0:1788463319.728837:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463319.728872:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36447 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dff8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729075:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3644e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729093:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3644e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729106:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3644e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729121:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729145:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729154:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729727:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729743:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff1 expref: 17 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729752:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729792:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff1 expref: 17 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.729807:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff1 expref: 17 pid: 8863 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463319.729823:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1875339408126592:192.168.204.11@tcp:104: 00000100:00100000:1.0:1788463319.732142:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec39b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463319.739828:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463319.742133:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1875339408126592:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463319.742276:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395538176 00000100:00100000:2.0:1788463319.742285:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395538176 00010000:00010000:1.0:1788463319.742305:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463319.742356:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:2.0:1788463319.742366:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:5594:x1875339395538176:12345-192.168.204.11@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788463319.743391:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:5594:x1875339395538176:12345-192.168.204.11@tcp:35:ldlm_bl.0 Request processed in 1022us (3568us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788463319.743401:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:3.0:1788463319.746023:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463319.746361:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395538304 00000100:00100000:2.0:1788463319.746374:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395538304 00010000:00010000:2.0:1788463319.746418:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff1 expref: 19 pid: 8863 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463319.746468:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 67 00000100:00100000:2.0:1788463319.746490:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:2355:x1875339395538304:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463319.746505:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463319.746511:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff1 expref: 19 pid: 8863 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.746527:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff1 expref: 19 pid: 8863 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.746552:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3642b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff1 expref: 19 pid: 8863 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.746570:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463319.746576:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.746586:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.746595:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.746665:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463319.746937:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.746947:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463319.747005:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788463319.747011:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463319.747038:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747053:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747063:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3644e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747069:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3644e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747084:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3644e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747089:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463319.747093:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3644e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747102:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3644e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747112:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:3.0:1788463319.747115:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463319.747120:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3644e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747126:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3644e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747142:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747148:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36455 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747155:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747160:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463319.747163:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747181:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747202:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5c519a000) 00010000:00010000:3.0:1788463319.747204:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463319.747374:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36455 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747382:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747427:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36447 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff8 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747443:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff8 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463319.747450:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:3.0:1788463319.747452:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463319.747455:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e200, rc 0) 00000100:00100000:2.0:1788463319.748103:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:2355:x1875339395538304:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 1620us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463319.748117:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 67 00000100:00100000:3.0:1788463319.748822:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:11440:x1875339395537920:12345-192.168.204.11@tcp:101:stat.0 Request processed in 20019us (24845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463319.748833:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 156 00000100:00100000:3.0:1788463319.802941:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463319.803196:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395538560 00000100:00100000:2.0:1788463319.803214:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395538560 00000100:00100000:2.0:1788463319.803298:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 157 00000100:00100000:2.0:1788463319.803308:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:11447:x1875339395538560:12345-192.168.204.11@tcp:36:truncate.0 00010000:00010000:2.0:1788463319.803384:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463319.804059:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3645c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dff8 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.804090:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463319.804095:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463319.804744:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.804762:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463319.804773:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463319.804840:0:8863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788463319.804886:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000411af932 reply state 000000009cfa1598 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463319.804910:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463319.805284:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11447:x1875339395538560:12345-192.168.204.11@tcp:36:truncate.0 Request processed in 1968us (2349us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788463319.805294:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 157 00000020:00080000:2.0:1788463319.805300:0:8863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788463319.822594:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463319.822623:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463319.822633:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463319.822640:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463319.822664:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463319.822673:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463319.822720:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:1.0:1788463319.822724:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463319.822729:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463319.822736:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36463 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.910061:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463319.998517:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463319.998674:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395538688 00000100:00100000:0.0:1788463319.998706:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395538688 00000100:00100000:0.0:1788463319.998779:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 158 00000100:00100000:0.0:1788463319.998789:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:11461:x1875339395538688:12345-192.168.204.11@tcp:101:stat.0 00010000:00010000:0.0:1788463319.998818:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463319.998864:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3646a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51dfff expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.998962:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36471 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.998978:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36471 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.998992:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36471 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999008:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36478 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999017:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999023:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999360:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999370:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999377:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463319.999418:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788463319.999423:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463319.999447:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999469:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999480:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36471 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999488:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36471 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999495:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36471 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999502:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463319.999508:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36471 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999517:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36471 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999545:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:0.0:1788463319.999548:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463319.999554:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36471 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999561:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36471 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999579:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999585:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36478 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999598:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999603:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463319.999606:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999614:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36478 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999623:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5c519ab00) 00010000:00010000:0.0:1788463319.999625:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463319.999628:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36478 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999633:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36478 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999679:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3646a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfff expref: 20 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999774:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfff expref: 19 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463319.999781:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:0.0:1788463319.999783:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463319.999786:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f800, rc 0) 00000100:00100000:0.0:1788463319.999891:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11461:x1875339395538688:12345-192.168.204.11@tcp:101:stat.0 Request processed in 1101us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463319.999909:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 158 00000100:00100000:2.0:1788463320.105904:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463320.106038:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395538944 00000100:00100000:3.0:1788463320.106048:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395538944 00000100:00100000:3.0:1788463320.106132:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 159 00000100:00080000:2.0:1788463320.106329:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463320.106462:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11471:x1875339395538944:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463320.106483:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463320.106504:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36486 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e006 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463320.106754:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788463320.106880:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36486 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e006 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.106895:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:3.0:1788463320.106899:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463320.106904:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee36486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e006 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.106917:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1400, rc 0) 00000100:00100000:3.0:1788463320.107090:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:11471:x1875339395538944:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 630us (1197us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788463320.107099:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 159 00000100:00100000:2.0:1788463320.118268:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463320.118359:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395539200 00000100:00100000:3.0:1788463320.118372:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395539200 00000100:00100000:3.0:1788463320.118443:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:3.0:1788463320.118456:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05a5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:11471:x1875339395539200:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463320.118830:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05a5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:11471:x1875339395539200:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 375us (575us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788463320.118839:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:0.0:1788463320.191153:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463320.193341:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395539456 00000100:00100000:2.0:1788463320.193359:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395539456 00000100:00100000:2.0:1788463320.193546:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 160 00000100:00100000:2.0:1788463320.193559:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:11477:x1875339395539456:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1788463320.194721:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463320.194759:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36494 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e00d expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.194917:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.194939:0:8863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfff expref: 22 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.194951:0:8863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.195007:0:8863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfff expref: 22 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.195025:0:8863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfff expref: 22 pid: 8864 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463320.195063:0:8863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408126720:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463320.195283:0:8863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c79a3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463320.200726:0:8863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8863:1875339408126720:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463320.200770:0:8863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463320.201945:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463320.202557:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395539584 00000100:00100000:2.0:1788463320.202570:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395539584 00010000:00010000:2.0:1788463320.202634:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfff expref: 23 pid: 8864 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463320.202715:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 68 00000100:00100000:2.0:1788463320.202728:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:2355:x1875339395539584:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463320.202746:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463320.202755:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfff expref: 23 pid: 8864 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.202771:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfff expref: 23 pid: 8864 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.202806:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3647f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfff expref: 23 pid: 8864 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.202831:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463320.202838:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.202870:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.202879:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.202915:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463320.202999:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:2355:x1875339395539584:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 272us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463320.203008:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 68 00010000:00010000:3.0:1788463320.203741:0:8863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.203759:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463320.203780:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788463320.203961:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36494 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e00d expref: 23 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.203980:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e00d expref: 22 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.203989:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:3.0:1788463320.203992:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788463320.203995:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39800, rc 0) 00000100:00100000:3.0:1788463320.204033:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:11477:x1875339395539456:12345-192.168.204.11@tcp:101:bash.0 Request processed in 10477us (12893us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788463320.204042:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 160 00000100:00100000:1.0:1788463320.210812:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463320.211948:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395539840 00000100:00100000:3.0:1788463320.211969:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395539840 00000100:00100000:3.0:1788463320.212052:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 161 00000100:00100000:3.0:1788463320.212062:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:11477:x1875339395539840:12345-192.168.204.11@tcp:36:bash.0 00010000:00010000:3.0:1788463320.212436:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.212458:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.212470:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463320.212541:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788463320.212567:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aefea970 reply state 000000007c90999f transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463320.212576:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463320.212669:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+25:11477:x1875339395539840:12345-192.168.204.11@tcp:36:bash.0 Request processed in 608us (1870us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788463320.212677:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 161 00000020:00080000:3.0:1788463320.212719:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788463320.216859:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.216877:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.216885:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.216891:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463320.216896:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.216903:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.216921:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:3.0:1788463320.216924:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463320.216929:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.216935:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463320.226863:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463320.227116:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395539968 00000100:00100000:3.0:1788463320.227127:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395539968 00000100:00100000:3.0:1788463320.227201:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 162 00000100:00100000:3.0:1788463320.227212:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11477:x1875339395539968:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:3.0:1788463320.227236:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463320.227258:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e014 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.227344:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.227358:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e00d expref: 25 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.227367:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.227400:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e00d expref: 25 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.227412:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e00d expref: 25 pid: 8863 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463320.227425:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee01180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1875339408126848:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463320.227514:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463320.233340:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463320.233489:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395540096 00000100:00100000:2.0:1788463320.233501:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395540096 00010000:00010000:2.0:1788463320.233567:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e00d expref: 26 pid: 8863 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463320.233617:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 69 00000100:00100000:2.0:1788463320.233628:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:2354:x1875339395540096:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463320.233644:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463320.233652:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e00d expref: 26 pid: 8863 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.233666:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e00d expref: 26 pid: 8863 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.233722:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463320.233729:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.233758:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.233765:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.233788:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463320.233858:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:2354:x1875339395540096:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 231us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463320.233866:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 69 00010000:00010000:3.0:1788463320.234402:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3649b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e00d expref: 25 pid: 8863 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463320.234436:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee01180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1875339408126848:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463320.234457:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.234467:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.234473:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463320.234533:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788463320.234539:0:5817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463320.234558:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.234589:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e014 expref: 25 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.234603:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e014 expref: 24 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.234609:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:3.0:1788463320.234612:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463320.234614:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1600, rc 0) 00000100:00100000:3.0:1788463320.234648:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11477:x1875339395539968:12345-192.168.204.11@tcp:101:bash.0 Request processed in 7439us (7798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463320.234655:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 162 00000100:00100000:1.0:1788463320.238278:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463320.238471:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395540352 00000100:00100000:3.0:1788463320.238485:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395540352 00000100:00100000:3.0:1788463320.238558:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:3.0:1788463320.238569:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11477:x1875339395540352:12345-192.168.204.11@tcp:35:bash.0 00000100:00100000:3.0:1788463320.238879:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+25:11477:x1875339395540352:12345-192.168.204.11@tcp:35:bash.0 Request processed in 310us (615us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788463320.238887:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:0.0:1788463320.339446:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463320.339857:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395540608 00000100:00100000:3.0:1788463320.339869:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395540608 00000100:00100000:3.0:1788463320.339970:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 163 00000100:00100000:3.0:1788463320.339984:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+25:11487:x1875339395540608:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463320.340025:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463320.340057:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e01b expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463320.340197:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788463320.340341:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e01b expref: 27 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.340358:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:3.0:1788463320.340361:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463320.340367:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee364be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e01b expref: 27 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.340382:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1400, rc 0) 00000100:00100000:3.0:1788463320.340449:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:11487:x1875339395540608:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 467us (1022us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1788463320.340473:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 163 00000100:00100000:0.0:1788463320.344117:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463320.344235:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395540736 00000100:00100000:1.0:1788463320.344248:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395540736 00000100:00100000:1.0:1788463320.344326:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 164 00000100:00100000:1.0:1788463320.344338:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:11487:x1875339395540736:12345-192.168.204.11@tcp:34:lfs.0 00010000:00010000:1.0:1788463320.344435:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.344457:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.344471:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.344487:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.344513:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.344519:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.344910:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.344921:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.344928:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463320.344978:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.344995:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345002:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345011:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345018:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463320.345023:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345032:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345056:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463320.345059:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463320.345067:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345075:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345091:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345098:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345104:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345109:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463320.345112:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345118:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345126:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d9430500) 00010000:00010000:1.0:1788463320.345129:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463320.345132:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345139:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345167:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345187:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345193:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345198:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463320.345201:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345208:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345216:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:1.0:1788463320.345219:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463320.345222:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.345228:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463320.345327:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:11487:x1875339395540736:12345-192.168.204.11@tcp:34:lfs.0 Request processed in 989us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463320.345337:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 164 00000100:00100000:1.0:1788463320.349110:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463320.355190:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395540992 00000100:00100000:3.0:1788463320.355212:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395540992 00000100:00100000:3.0:1788463320.355293:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:3.0:1788463320.355303:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:11487:x1875339395540992:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463320.355681:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:11487:x1875339395540992:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 378us (6788us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788463320.355795:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:3.0:1788463320.400857:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463320.401064:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395541248 00000100:00100000:1.0:1788463320.401078:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395541248 00000100:00100000:1.0:1788463320.401153:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 165 00000100:00100000:1.0:1788463320.401164:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:11490:x1875339395541248:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463320.401201:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463320.401225:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e022 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.401303:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.401324:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.401338:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.401353:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.401360:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.401366:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.401765:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee364f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.401778:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee364f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.401786:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee364f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463320.401807:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788463320.402226:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402235:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402242:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402248:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463320.402253:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402261:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402274:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463320.402277:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463320.402282:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402289:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee364e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402302:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402309:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402332:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402338:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463320.402341:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402348:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402355:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d9430500) 00010000:00010000:1.0:1788463320.402358:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463320.402361:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402366:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee364ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402418:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee364e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e022 expref: 30 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402435:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee364f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e022 expref: 29 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463320.402441:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:1.0:1788463320.402443:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463320.402446:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489000, rc 0) 00000100:00100000:1.0:1788463320.402526:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:11490:x1875339395541248:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1362us (1682us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788463320.402544:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 165 00000100:00100000:0.0:1788463320.406232:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463320.406808:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395541376 00000100:00100000:2.0:1788463320.406819:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395541376 00000100:00100000:2.0:1788463320.406919:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 166 00000100:00100000:2.0:1788463320.406931:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:11490:x1875339395541376:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:2.0:1788463320.407014:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.407033:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.407046:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.407079:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.407086:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36504 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.407094:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.407114:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463320.407119:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463320.407343:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463320.407503:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395541504 00000100:00100000:0.0:1788463320.407508:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395541504 00000100:00100000:0.0:1788463320.407637:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:0.0:1788463320.407646:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:2354:x1875339395541504:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463320.407658:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463320.407678:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee364f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e022 expref: 30 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.407729:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:0.0:1788463320.407735:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463320.407786:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:2354:x1875339395541504:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 141us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463320.407793:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00010000:00010000:2.0:1788463320.407842:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36504 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.407852:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463320.407855:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463320.407859:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36504 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.407866:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463320.407916:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+28:11490:x1875339395541376:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 987us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463320.407923:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 166 00000100:00100000:0.0:1788463320.412402:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463320.412481:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395541760 00000100:00100000:2.0:1788463320.412491:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395541760 00000100:00100000:2.0:1788463320.412564:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:2.0:1788463320.412575:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+28:11490:x1875339395541760:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:2.0:1788463320.413186:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:11490:x1875339395541760:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 600us (781us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788463320.413195:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:0.0:1788463320.577498:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463320.580456:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395542016 00000100:00100000:2.0:1788463320.580474:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395542016 00000100:00100000:3.0:1788463320.584618:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 167 00000100:00100000:3.0:1788463320.584634:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:11508:x1875339395542016:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:3.0:1788463320.584661:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463320.584698:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3650b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e029 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.584827:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36512 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.584844:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36512 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.584857:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36512 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463320.584870:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788463320.585013:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3650b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e029 expref: 32 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.585056:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36512 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e029 expref: 31 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.585065:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:3.0:1788463320.585068:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788463320.585071:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1e00, rc 0) 00000100:00100000:3.0:1788463320.585157:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:11508:x1875339395542016:12345-192.168.204.11@tcp:101:cat.0 Request processed in 527us (7670us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788463320.585164:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 167 00000100:00100000:0.0:1788463320.609419:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463320.610315:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395542144 00000100:00100000:3.0:1788463320.610328:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395542144 00000100:00100000:2.0:1788463320.611291:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 168 00000100:00100000:2.0:1788463320.611322:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:11509:x1875339395542144:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463320.611351:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463320.611484:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e030 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.611645:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee36527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.611664:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee36527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.611677:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee36527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463320.611868:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788463320.611872:0:8863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463320.611890:0:8863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee36527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.611918:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36520 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e030 expref: 33 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.611937:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee36527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e030 expref: 32 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.611945:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:2.0:1788463320.611948:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463320.611952:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39400, rc 0) 00000100:00100000:2.0:1788463320.612222:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11509:x1875339395542144:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 902us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463320.612241:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 168 00000100:00100000:1.0:1788463320.614743:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408126976:0@lo:400:kworker.0 00000100:00100000:1.0:1788463320.614858:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463320.614910:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408126976 00000100:00100000:2.0:1788463320.614919:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408126976 00000100:00100000:2.0:1788463320.614990:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788463320.615083:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408126976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463320.615373:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408127104:0@lo:400:kworker.0 00000100:00100000:0.0:1788463320.615411:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463320.617642:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408126976:12345-0@lo:400:kworker.0 Request processed in 2634us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463320.619237:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788463320.619323:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408127232:0@lo:400:kworker.0 00000100:00100000:2.0:1788463320.619441:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463320.619473:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408127616:0@lo:400:kworker.0 00000100:00100000:2.0:1788463320.619483:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463320.619492:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408127360:0@lo:400:kworker.0 00000100:00100000:3.0:1788463320.619519:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463320.619596:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463320.619603:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463320.619631:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408127104 00000100:00100000:2.0:1788463320.619637:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408127104 00000100:00100000:3.0:1788463320.619724:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ebc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408127488:0@lo:400:kworker.0 00000100:00100000:3.0:1788463320.619751:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463320.619791:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408127232 00000100:00100000:3.0:1788463320.619796:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408127232 00000100:00100000:2.0:1788463320.619802:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408127360 00000100:00100000:2.0:1788463320.619808:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408127360 00000100:00100000:3.0:1788463320.619837:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408127616 00000100:00100000:2.0:1788463320.619841:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408127488 00000100:00100000:3.0:1788463320.619842:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408127616 00000100:00100000:2.0:1788463320.619846:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408127488 00000100:00100000:3.0:1788463320.619876:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788463320.619880:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788463320.619889:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408127232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463320.619892:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408127104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463320.619949:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408127104:12345-0@lo:400:kworker.0 Request processed in 62us (4538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463320.619955:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788463320.619968:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788463320.619973:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408127360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463320.620151:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408127232:12345-0@lo:400:kworker.0 Request processed in 264us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463320.620152:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408127360:12345-0@lo:400:kworker.0 Request processed in 177us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463320.620178:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788463320.620194:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788463320.620321:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3277:x1875339408127616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463320.620353:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3277:x1875339408127616:12345-0@lo:400:kworker.0 Request processed in 34us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463320.620359:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788463320.620402:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408127360:0@lo:400:kworker.0 00000100:00100000:3.0:1788463320.620413:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408127232:0@lo:400:kworker.0 00000100:00100000:3.0:1788463320.620443:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408127616:0@lo:400:kworker.0 00000100:00100000:3.0:1788463320.620454:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408127104:0@lo:400:kworker.0 00000100:00100000:3.0:1788463320.620519:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463320.620616:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408126976:0@lo:400:kworker.0 00000100:00100000:2.0:1788463320.620972:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788463320.621178:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788463320.621191:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408127488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463320.621354:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408127488:12345-0@lo:400:kworker.0 Request processed in 167us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463320.621362:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788463320.621394:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ebc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408127488:0@lo:400:kworker.0 00000100:00100000:3.0:1788463320.621415:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395542528 00000100:00100000:3.0:1788463320.621419:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395542528 00000100:00100000:3.0:1788463320.621448:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:3.0:1788463320.621455:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11509:x1875339395542528:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463320.621873:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:11509:x1875339395542528:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 416us (1356us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788463320.621881:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00080000:3.0:1788463320.621918:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463320.621932:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463320.627598:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463320.628164:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395542656 00000100:00100000:2.0:1788463320.628185:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395542656 00000100:00100000:2.0:1788463320.628300:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1788463320.628311:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:11509:x1875339395542656:12345-192.168.204.11@tcp:103:lfs.0 00010000:00010000:2.0:1788463320.628327:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788463320.628352:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee364b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e014 expref: 33 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.628374:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36512 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e029 expref: 32 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.628388:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee363bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dfd5 expref: 31 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463320.628398:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463320.628409:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463320.628470:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:11509:x1875339395542656:12345-192.168.204.11@tcp:103:lfs.0 Request processed in 161us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463320.628478:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:1.0:1788463320.631659:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463320.632080:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395542784 00000100:00100000:3.0:1788463320.632091:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395542784 00000100:00100000:3.0:1788463320.632205:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 169 00000100:00100000:3.0:1788463320.632217:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:11509:x1875339395542784:12345-192.168.204.11@tcp:58:lfs.0 00010000:00010000:3.0:1788463320.632339:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3652e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.632360:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3652e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463320.632376:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3652e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463320.633277:0:8864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788463320.633386:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:11509:x1875339395542784:12345-192.168.204.11@tcp:58:lfs.0 Request processed in 1170us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463320.633397:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 169 00000100:00100000:3.0:1788463320.676092:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463320.681021:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395542912 00000100:00100000:1.0:1788463320.681039:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395542912 00000100:00100000:0.0:1788463320.681320:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 170 00000100:00100000:0.0:1788463320.681332:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:11511:x1875339395542912:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463320.681354:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463320.681377:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36535 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e037 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.681451:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3653c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.681470:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3653c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.681483:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3653c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.681500:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.681507:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.681514:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.681899:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.681909:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.681917:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463320.681965:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788463320.681970:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463320.681996:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682010:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682019:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3653c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682027:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3653c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682034:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3653c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682041:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463320.682046:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3653c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682056:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3653c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682071:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:0.0:1788463320.682074:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463320.682080:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3653c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682089:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3653c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682116:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682122:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36543 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682128:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682134:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463320.682137:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682144:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682152:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5c519ab00) 00010000:00010000:0.0:1788463320.682155:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463320.682158:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36543 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682163:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682212:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36535 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e037 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682228:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e037 expref: 31 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463320.682246:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0217500) 00010000:00010000:0.0:1788463320.682249:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463320.682252:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f400, rc 0) 00000100:00100000:0.0:1788463320.682321:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:11511:x1875339395542912:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 990us (6247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463320.682329:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 170 00010000:00010000:2.0:1788463320.936521:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463321.061091:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463321.061101:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463321.061140:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788463321.061149:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463321.061288:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fea88380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408127744:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788463321.061392:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec39b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788463321.067714:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463321.067956:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fea88380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408127744:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788463321.067978:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395543040 00000100:00100000:3.0:1788463321.067987:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395543040 00000100:00100000:3.0:1788463321.068058:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 171 00000100:00100000:3.0:1788463321.068068:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:11522:x1875339395543040:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788463321.068111:0:8863:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788463321.068244:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:11522:x1875339395543040:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 176us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.068252:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 171 00000100:00100000:3.0:1788463321.079560:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463321.080909:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395543168 00000100:00100000:0.0:1788463321.080924:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395543168 00000100:00100000:1.0:1788463321.081076:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 172 00000100:00100000:1.0:1788463321.081088:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:11522:x1875339395543168:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788463321.081186:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36551 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081202:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36551 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081215:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36551 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081254:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36558 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081261:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36558 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081267:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36558 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081318:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081326:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081333:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463321.081371:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788463321.081375:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463321.081390:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081402:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36551 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081410:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36551 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081417:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36551 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081422:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463321.081427:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36551 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081434:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36551 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081446:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:1.0:1788463321.081456:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463321.081461:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36551 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081467:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36551 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081479:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36558 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081485:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36558 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081504:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36558 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081517:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463321.081519:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36558 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081524:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36558 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081532:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9ba5d9430500) 00010000:00010000:1.0:1788463321.081534:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463321.081537:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36558 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081542:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36558 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081557:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081569:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081574:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081578:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463321.081581:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081586:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081593:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0217500) 00010000:00010000:1.0:1788463321.081595:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463321.081598:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.081603:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3655f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463321.081733:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:11522:x1875339395543168:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 Request processed in 646us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463321.081742:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 172 00000100:00100000:1.0:1788463321.086361:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463321.086438:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395543424 00000100:00100000:0.0:1788463321.086449:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395543424 00000100:00100000:0.0:1788463321.086525:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 173 00000100:00100000:0.0:1788463321.086535:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:11522:x1875339395543424:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463321.086557:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463321.086581:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36566 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e03e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.086751:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3656d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.086768:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3656d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.086797:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3656d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463321.086811:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788463321.087279:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3656d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.087298:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3656d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.087305:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3656d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.087310:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463321.087315:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3656d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.087323:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3656d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.087335:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0217500) 00010000:00010000:2.0:1788463321.087338:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463321.087342:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3656d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.087348:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3656d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.087393:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36566 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e03e expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.087402:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:2.0:1788463321.087404:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463321.087408:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36566 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e03e expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.087418:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e200, rc 0) 00000100:00100000:2.0:1788463321.087484:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11522:x1875339395543424:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 951us (1136us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788463321.087499:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 173 00000100:00100000:3.0:1788463321.099025:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.099287:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395543552 00000100:00100000:2.0:1788463321.099302:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395543552 00000100:00100000:2.0:1788463321.099393:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 174 00000100:00100000:2.0:1788463321.099406:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11522:x1875339395543552:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788463321.099462:0:5817:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788463321.099639:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11522:x1875339395543552:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 235us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.099649:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 174 00000100:00100000:3.0:1788463321.113054:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463321.113355:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395543808 00000100:00100000:1.0:1788463321.113367:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395543808 00000100:00100000:1.0:1788463321.113431:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 175 00000100:00100000:1.0:1788463321.113442:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11522:x1875339395543808:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463321.113479:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463321.113482:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788463321.113520:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee36527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e030 expref: 32 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.113541:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463321.113546:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463321.113561:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3657b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e045 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463321.114386:0:5818:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788463321.114638:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.114656:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.114668:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.114765:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee3657b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e045 expref: 34 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.114782:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e045 expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.114791:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d9430500) 00010000:00010000:1.0:1788463321.114794:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463321.114806:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489e00, rc 0) 00000100:00100000:1.0:1788463321.114876:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:11522:x1875339395543808:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 1436us (1834us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788463321.114885:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 175 00000100:00100000:0.0:1788463321.122944:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.123089:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395544064 00000100:00100000:2.0:1788463321.123104:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395544064 00000100:00100000:2.0:1788463321.123192:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 176 00000100:00100000:2.0:1788463321.123203:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:11522:x1875339395544064:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788463321.123268:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463321.123298:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e045 expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123318:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d9430500) 00010000:00010000:2.0:1788463321.123328:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463321.123352:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36590 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123367:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36590 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123376:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36590 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123400:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36597 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xdae90102 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123407:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdae90102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123414:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdae90102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123675:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36590 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123709:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36590 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123716:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36590 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123722:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463321.123727:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36590 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123735:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36590 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123744:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:2.0:1788463321.123747:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463321.123751:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36590 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123758:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36590 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123773:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdae90102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123779:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36597 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdae90102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123785:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36597 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdae90102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123789:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463321.123792:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36597 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdae90102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123798:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36597 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdae90102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123804:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xdae90102 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463321.123806:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463321.123808:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36597 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdae90102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.123813:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36597 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdae90102 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.123907:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11522:x1875339395544064:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 705us (982us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788463321.123914:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 176 00000100:00100000:3.0:1788463321.126312:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463321.126341:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408127872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463321.126429:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463321.127361:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408127872 00000100:00100000:3.0:1788463321.127372:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408127872 00000100:00100000:3.0:1788463321.127434:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788463321.127447:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408127872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463321.127925:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463321.128093:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408127872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 645us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.128103:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788463321.133229:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.133321:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395544192 00000100:00100000:3.0:1788463321.133332:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395544192 00000100:00100000:3.0:1788463321.133405:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 177 00000100:00100000:3.0:1788463321.133417:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fea8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11522:x1875339395544192:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463321.133451:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463321.133484:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee3659e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e04c expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.133542:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.133557:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.133570:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.133745:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee3659e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e04c expref: 34 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.133766:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e04c expref: 33 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.133776:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d0217900) 00010000:00010000:3.0:1788463321.133780:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463321.133784:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1e00, rc 0) 00000100:00100000:3.0:1788463321.133863:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fea8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:11522:x1875339395544192:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 448us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.133871:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 177 00000100:00100000:2.0:1788463321.134303:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408127872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463321.152297:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.155242:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395544448 00000100:00100000:3.0:1788463321.155255:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395544448 00000100:00100000:3.0:1788463321.155343:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 178 00000100:00100000:3.0:1788463321.155356:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+33:11522:x1875339395544448:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463321.155475:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.155497:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.155514:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463321.157152:0:8863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788463321.157370:0:8863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352767685010ns, next at 353767681912ns, rc = 0 00000004:00010000:3.0:1788463321.157835:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f82b4054 reply state 000000006596690a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463321.157848:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463321.158063:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:11522:x1875339395544448:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 2703us (5773us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788463321.158074:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 178 00010000:00010000:0.0:1788463321.161336:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.161358:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.161367:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.161374:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463321.162198:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.162219:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.162244:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d0217900) 00010000:00010000:0.0:1788463321.162248:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788463321.162254:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.162262:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee365ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463321.163404:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463321.163745:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395544576 00000100:00100000:0.0:1788463321.163764:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395544576 00000100:00100000:0.0:1788463321.163869:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 179 00000100:00100000:0.0:1788463321.163881:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:11522:x1875339395544576:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463321.163909:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463321.163934:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee365b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e053 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.164005:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee365b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e053 expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.164023:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee365b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e053 expref: 35 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.164047:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d0217900) 00010000:00010000:0.0:1788463321.164050:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463321.164054:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e200, rc 0) 00000100:00100000:0.0:1788463321.164139:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:11522:x1875339395544576:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 259us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463321.164148:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 179 00000100:00100000:0.0:1788463321.168784:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.168879:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395544704 00000100:00100000:2.0:1788463321.168892:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395544704 00000100:00080000:0.0:1788463321.168971:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463321.168983:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:2.0:1788463321.168997:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395544704:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788463321.169490:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395544704:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 493us (715us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788463321.169499:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:2.0:1788463321.183818:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.183956:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395544960 00000100:00100000:3.0:1788463321.183972:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395544960 00000100:00100000:3.0:1788463321.184069:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:3.0:1788463321.184085:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:11522:x1875339395544960:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788463321.184403:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+36:11522:x1875339395544960:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 321us (599us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788463321.184412:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:2.0:1788463321.194359:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463321.194421:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395545216 00000100:00100000:1.0:1788463321.194434:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395545216 00000100:00100000:1.0:1788463321.194519:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 180 00000100:00100000:1.0:1788463321.194530:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+36:11522:x1875339395545216:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788463321.194748:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+36:11522:x1875339395545216:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 217us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463321.194758:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 180 00000100:00100000:1.0:1788463321.198539:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.198612:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395545344 00000100:00100000:3.0:1788463321.198623:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395545344 00000100:00100000:3.0:1788463321.198731:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 181 00000100:00100000:3.0:1788463321.198742:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+36:11522:x1875339395545344:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463321.198768:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463321.198792:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e05a expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.198929:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee365c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.198949:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee365c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.198973:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee365c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463321.199024:0:8863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463321.199048:0:8863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee365c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.199077:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e05a expref: 38 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.199101:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee365c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e05a expref: 37 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.199111:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d0217900) 00010000:00010000:3.0:1788463321.199114:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788463321.199119:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0600, rc 0) 00000100:00100000:3.0:1788463321.199210:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:11522:x1875339395545344:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 470us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.199218:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 181 00000100:00100000:3.0:1788463321.203100:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463321.203324:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395545472 00000100:00100000:1.0:1788463321.203336:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395545472 00000100:00100000:1.0:1788463321.203388:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:1.0:1788463321.203401:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395545472:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463321.203426:0:8660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463321.203454:0:8660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084b51ebd/0xc3fe72277ee365c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e061 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463321.203502:0:8660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99c8d9, blocks: 0x1 00010000:00010000:1.0:1788463321.203535:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:1.0:1788463321.203540:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463321.203552:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084b51ebd/0xc3fe72277ee365c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e061 expref: 8 pid: 8660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.203590:0:8660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084b51ebd/0xc3fe72277ee365c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e061 expref: 8 pid: 8660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.203608:0:8660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488800, rc 0) 00000100:00100000:1.0:1788463321.203720:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395545472:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 322us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463321.203730:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:1.0:1788463321.211971:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.212053:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395545728 00000100:00100000:3.0:1788463321.212064:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395545728 00000100:00100000:3.0:1788463321.212129:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 182 00000100:00100000:3.0:1788463321.212141:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:11522:x1875339395545728:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788463321.212646:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:11522:x1875339395545728:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 495us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.212658:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 182 00000100:00100000:1.0:1788463321.216453:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.216640:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395545856 00000100:00100000:2.0:1788463321.216655:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395545856 00000100:00100000:2.0:1788463321.216773:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 54 00000100:00100000:2.0:1788463321.216785:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:11522:x1875339395545856:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463321.216813:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463321.216838:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e068 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.216875:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084b51ebd/0xc3fe72277ee365c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e061 expref: 9 pid: 8660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.216887:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463321.216904:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463321.216911:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 9 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.216966:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084b51ebd/0xc3fe72277ee365c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e061 expref: 9 pid: 8660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.217004:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084b51ebd/0xc3fe72277ee365c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e061 expref: 9 pid: 8660 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.217022:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6668:1875339408128000:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463321.217146:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c79a3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463321.223752:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6668:1875339408128000:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463321.223793:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 9 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.223814:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39600, rc 0) 00000100:00100000:3.0:1788463321.223876:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:11522:x1875339395545856:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 7094us (7431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.223885:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 54 00000100:00100000:1.0:1788463321.232359:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463321.232435:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395545984 00000100:00100000:0.0:1788463321.232448:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395545984 00010000:00010000:0.0:1788463321.232514:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084b51ebd/0xc3fe72277ee365c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e061 expref: 9 pid: 8660 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463321.232629:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 70 00000100:00100000:0.0:1788463321.232640:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2355:x1875339395545984:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463321.232678:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463321.232722:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084b51ebd/0xc3fe72277ee365c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e061 expref: 9 pid: 8660 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.232737:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084b51ebd/0xc3fe72277ee365c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e061 expref: 9 pid: 8660 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.232760:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084b51ebd/0xc3fe72277ee365c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e061 expref: 9 pid: 8660 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.232775:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463321.232779:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463321.232787:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.232797:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.232837:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463321.232851:0:5802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5802:1875339408128128:192.168.204.11@tcp:105: 00000100:00100000:0.0:1788463321.234198:0:5802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec39b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788463321.240248:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.240913:0:5802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5802:1875339408128128:192.168.204.11@tcp:105: 00010000:00010000:3.0:1788463321.240954:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463321.241018:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395545984:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 8380us (8672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.241030:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 70 00000100:00100000:0.0:1788463321.242314:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395546112 00000100:00100000:0.0:1788463321.242326:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395546112 00002000:00100000:0.0:1788463321.242376:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ba5f795b480 x1875339395546112/t0(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:457/0 lens 504/0 e 0 to 0 dl 1788463332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463321.242402:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5f795b480 with x1875339395546112 ext(0->8) 00002000:00010000:0.0:1788463321.242408:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5f795b480 00000100:00100000:0.0:1788463321.242612:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:0.0:1788463321.242626:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395546112:12345-192.168.204.11@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788463321.245972:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:2355:x1875339395546112:12345-192.168.204.11@tcp:4:lhsmtool_posix.0 Request processed in 3327us (5719us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788463321.245993:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00002000:00100000:0.0:1788463321.246010:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ba5f795b480 x1875339395546112/t4294967314(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:457/0 lens 504/448 e 0 to 0 dl 1788463332 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788463321.246023:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5f795b480 with x1875339395546112 ext(0->8) 00002000:00010000:0.0:1788463321.246031:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5f795b480 00000100:00100000:1.0:1788463321.251787:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.252036:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395546240 00000100:00100000:3.0:1788463321.252051:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395546240 00000100:00100000:3.0:1788463321.252129:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 183 00000100:00100000:3.0:1788463321.252141:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:11522:x1875339395546240:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788463321.359396:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:11522:x1875339395546240:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 Request processed in 107242us (107603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.359414:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 183 00000020:00080000:3.0:1788463321.359458:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1788463321.359481:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:3.0:1788463321.359511:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788463321.359518:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:3.0:1788463321.362072:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000020:00080000:3.0:1788463321.362109:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788463321.362133:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788463321.362291:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408128256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788463321.362340:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463321.362404:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395546368 00000100:00100000:3.0:1788463321.362412:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395546368 00000100:00100000:3.0:1788463321.362452:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408128256 00000100:00100000:3.0:1788463321.362455:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408128256 00000100:00100000:3.0:1788463321.362488:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:3.0:1788463321.362496:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:2354:x1875339395546368:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788463321.362555:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788463321.362562:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408128256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788463321.362724:0:6665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788463321.362728:0:6665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788463321 00002000:00010000:3.0:1788463321.362730:0:6665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788463321.362732:0:6665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788463321 -> 1788463321 00002000:00010000:3.0:1788463321.362735:0:6665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788463321.362770:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875339408128256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (430us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788463321.362777:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788463321.362794:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788463321.363058:0:3279:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5fee4c700/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788463321.363064:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408128256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788463321.388293:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:2354:x1875339395546368:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 Request processed in 25783us (26663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463321.388309:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 55 00000001:00080000:3.0:1788463321.391352:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:3.0:1788463321.391378:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1788463321.391490:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.391821:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395546624 00000100:00100000:3.0:1788463321.391834:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395546624 00000100:00100000:2.0:1788463321.392072:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 184 00000100:00100000:2.0:1788463321.392085:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:11522:x1875339395546624:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788463321.392148:0:8864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463321.392202:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee365c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e05a expref: 18 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.392223:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d0217900) 00010000:00010000:2.0:1788463321.392228:0:8864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463321.392262:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.392276:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.392285:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463321.392996:0:8864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000906c75c1 reply state 000000005f71c9ac transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.393009:0:8864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788463321.393145:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11522:x1875339395546624:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 1060us (1660us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788463321.393168:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 184 00010000:00010000:3.0:1788463321.396241:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.396275:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.396283:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.396288:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463321.396294:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.396302:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.396321:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d0217900) 00010000:00010000:3.0:1788463321.396324:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463321.396329:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.396335:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee365d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463321.397150:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.397338:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395546752 00000100:00100000:3.0:1788463321.397348:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395546752 00000100:00100000:3.0:1788463321.397407:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:3.0:1788463321.397415:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395546752:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788463321.397780:0:6665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788463321.397784:0:6665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788463321 -> 1788463320 00002000:00010000:3.0:1788463321.397786:0:6665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788463319 00002000:00010000:3.0:1788463321.397789:0:6665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788463321 -> 1788463320 00002000:00010000:3.0:1788463321.397808:0:6665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788463321.397901:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395546752:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 485us (759us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788463321.397911:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:1.0:1788463321.401653:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.401881:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395547008 00000100:00100000:3.0:1788463321.401893:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395547008 00000100:00100000:3.0:1788463321.401957:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 185 00000100:00100000:3.0:1788463321.401968:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:11522:x1875339395547008:12345-192.168.204.11@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788463321.402040:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.402059:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e04c expref: 18 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.402068:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.402103:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e04c expref: 18 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.402118:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e04c expref: 18 pid: 8864 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463321.402132:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1875339408128384:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463321.402360:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e05c4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788463321.406718:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1875339408128384:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463321.406758:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463321.409148:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.409383:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395547136 00000100:00100000:2.0:1788463321.409393:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395547136 00010000:00010000:2.0:1788463321.409434:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e04c expref: 19 pid: 8864 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.409474:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 71 00000100:00100000:2.0:1788463321.409483:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:2354:x1875339395547136:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463321.409497:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463321.409513:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e04c expref: 19 pid: 8864 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.409527:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e04c expref: 19 pid: 8864 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.409551:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee365a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e04c expref: 19 pid: 8864 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.409569:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d0217900) 00010000:00010000:2.0:1788463321.409574:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.409584:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.409593:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.409786:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463321.409834:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:2354:x1875339395547136:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 351us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.409843:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 71 00010000:00010000:0.0:1788463321.410427:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.410437:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.410468:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.410475:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.410493:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.410508:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463321.410514:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.410523:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.410535:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d0217900) 00010000:00010000:0.0:1788463321.410538:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788463321.410541:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.410547:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee365dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463321.410614:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:11522:x1875339395547008:12345-192.168.204.11@tcp:55:lhsmtool_posix.0 Request processed in 8647us (8984us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788463321.410622:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 185 00000100:00100000:1.0:1788463321.438134:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.438294:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395547264 00000100:00100000:3.0:1788463321.438304:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395547264 00000100:00100000:3.0:1788463321.438370:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:3.0:1788463321.438380:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395547264:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788463321.438429:0:8660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.438452:0:8660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.438462:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788463321.438466:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463321.438471:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.438515:0:8660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.438530:0:8660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 8 pid: 6668 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463321.438545:0:8660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8660:1875339408128512:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463321.438639:0:8660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e05c4540 going to sleep for 11 seconds 00000100:00100000:1.0:1788463321.442562:0:8660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8660:1875339408128512:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463321.442609:0:8660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463321.446658:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.446809:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395547392 00000100:00100000:3.0:1788463321.446823:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395547392 00010000:00010000:3.0:1788463321.446882:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 9 pid: 6668 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463321.446929:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00100000:3.0:1788463321.446939:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2354:x1875339395547392:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463321.446953:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463321.446978:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 9 pid: 6668 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.446993:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 9 pid: 6668 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.447018:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee365cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e068 expref: 9 pid: 6668 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.447036:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463321.447040:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788463321.447046:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.447055:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.447094:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463321.447248:0:8660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.447260:0:8660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.447288:0:8660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.447297:0:8660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.447304:0:8660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.447310:0:8660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463321.447315:0:8660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.447324:0:8660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.447349:0:8660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.447357:0:8660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd32285/0xc3fe72277ee365e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.447403:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395547264:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 Request processed in 9024us (9283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.447412:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:3.0:1788463321.447454:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395547392:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 212us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.447463:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00100000:2.0:1788463321.463281:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.463319:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395547648 00000100:00100000:2.0:1788463321.463328:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395547648 00000100:00100000:2.0:1788463321.463384:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 186 00000100:00100000:2.0:1788463321.463395:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+17:11522:x1875339395547648:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788463321.463477:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee365eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.463496:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee365eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.463522:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee365eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.463824:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.463837:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee365b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e053 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.463861:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.463904:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee365b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e053 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.463923:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee365b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e053 expref: 18 pid: 5817 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.463941:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec8f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1875339408128640:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463321.464037:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c79a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463321.471242:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.471457:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec8f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1875339408128640:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463321.471492:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.473272:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395547776 00000100:00100000:2.0:1788463321.473288:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395547776 00010000:00010000:2.0:1788463321.473338:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee365b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e053 expref: 19 pid: 5817 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.473380:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 73 00000100:00100000:2.0:1788463321.473389:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:2355:x1875339395547776:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463321.473406:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463321.473414:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee365b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e053 expref: 19 pid: 5817 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.473429:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee365b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e053 expref: 19 pid: 5817 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.473458:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee365b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e053 expref: 19 pid: 5817 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.473490:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d0217900) 00010000:00010000:2.0:1788463321.473497:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.473508:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.473518:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.473560:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463321.473621:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+18:2355:x1875339395547776:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 232us (2391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.473628:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 73 00010000:00010000:0.0:1788463321.474282:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.474292:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463321.474493:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788463321.474654:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788463321.474740:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788463321.474828:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5816:1875339408128768:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788463321.474888:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463321.474925:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463321.475076:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408128768 00000100:00100000:1.0:1788463321.475084:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408128768 00000100:00100000:1.0:1788463321.475136:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463321.475145:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5816:x1875339408128768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788463321.476777:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5816:x1875339408128768:12345-0@lo:1000:mdt00_000.0 Request processed in 1624us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463321.476791:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788463321.477185:0:5816:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788463321.477193:0:5816:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5fee4c700, transno 4294967315 00000100:00100000:0.0:1788463321.477215:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5816:1875339408128768:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788463321.477782:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788463321.477896:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5816:1875339408128896:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788463321.477989:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463321.478028:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481240 going to sleep for 11 seconds 00000100:00100000:1.0:1788463321.478340:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408128896 00000100:00100000:1.0:1788463321.478348:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408128896 00000100:00100000:1.0:1788463321.478392:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463321.478400:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5816:x1875339408128896:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788463321.478608:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5816:x1875339408128896:12345-0@lo:1000:mdt00_000.0 Request processed in 208us (619us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788463321.478615:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463321.480012:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5816:1875339408128896:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788463321.480068:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480081:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480089:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480095:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463321.480100:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480109:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480129:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d0217900) 00010000:00010000:3.0:1788463321.480134:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463321.480140:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480276:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee365f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480322:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3652e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480346:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3652e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480352:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3652e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480357:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463321.480360:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3652e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480365:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3652e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480374:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0217500) 00010000:00010000:3.0:1788463321.480376:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463321.480379:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3652e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480385:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3652e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480413:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480431:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e037 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480441:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480495:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e037 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.480523:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e037 expref: 21 pid: 5816 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463321.480541:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1875339408129024:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463321.480666:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e05c4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463321.492284:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.492809:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395547904 00000100:00100000:2.0:1788463321.492823:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395547904 00010000:00010000:2.0:1788463321.492879:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e037 expref: 22 pid: 5816 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.492935:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 74 00000100:00100000:2.0:1788463321.492963:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:2354:x1875339395547904:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463321.492982:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463321.492990:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e037 expref: 22 pid: 5816 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.493003:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e037 expref: 22 pid: 5816 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.493040:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0217500) 00010000:00010000:2.0:1788463321.493046:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.493056:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.493064:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.493087:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463321.493175:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:2354:x1875339395547904:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 229us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.493185:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 74 00010000:00010000:1.0:1788463321.494194:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3654a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e037 expref: 21 pid: 5816 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463321.494218:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5816:1875339408129024:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463321.494247:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494256:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494261:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494273:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494280:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494295:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494300:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463321.494304:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494312:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494325:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0217500) 00010000:00010000:1.0:1788463321.494328:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463321.494332:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494338:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee365f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494350:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee365eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494356:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee365eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494360:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee365eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494365:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463321.494368:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee365eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494383:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee365eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494392:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0217500) 00010000:00010000:1.0:1788463321.494394:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788463321.494397:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee365eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.494402:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee365eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463321.495012:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:11522:x1875339395547648:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 31615us (31736us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788463321.495022:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 186 00000020:00080000:1.0:1788463321.495028:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788463321.496300:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463321.496310:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463321.497159:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788463321.497180:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788463321.500994:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463321.507821:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395548160 00000100:00100000:1.0:1788463321.507848:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395548160 00000100:00100000:1.0:1788463321.507936:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:1.0:1788463321.507950:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:11522:x1875339395548160:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788463321.508773:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788463321.511298:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788463321.511401:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.511424:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.511438:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.511474:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.511480:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.511486:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.511550:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788463321.511717:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:11522:x1875339395548160:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 3763us (10726us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788463321.511730:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 50 00000020:00080000:1.0:1788463321.511736:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788463321.517192:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463321.517213:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.517227:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463321.517232:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.517245:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.517265:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ba5d9430900) 00010000:00010000:2.0:1788463321.517278:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788463321.517284:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.517291:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36600 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.517316:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463321.517318:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463321.517319:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463321.589328:0:12505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463321.589345:0:12505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463321.589409:0:12505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788463321.589416:0:12505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788463321.702107:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463321.702205:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395548416 00000100:00100000:1.0:1788463321.702216:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395548416 00000100:00100000:1.0:1788463321.702283:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 187 00000100:00100000:1.0:1788463321.702293:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:11532:x1875339395548416:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463321.702323:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463321.702349:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36607 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e06f expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.702458:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee3660e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.702472:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee3660e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.702483:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee3660e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463321.702519:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788463321.702670:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36607 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e06f expref: 25 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.702708:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee3660e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e06f expref: 24 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.702717:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463321.702720:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788463321.702724:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488800, rc 0) 00000100:00100000:1.0:1788463321.702784:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec8f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11532:x1875339395548416:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 492us (686us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788463321.702792:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 187 00000100:00100000:2.0:1788463321.710016:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463321.712509:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395548544 00000100:00100000:0.0:1788463321.712525:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395548544 00000100:00100000:2.0:1788463321.714587:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 188 00000100:00100000:2.0:1788463321.714604:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11532:x1875339395548544:12345-192.168.204.11@tcp:34:lfs.0 00010000:00010000:2.0:1788463321.714726:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3661c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.714746:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3661c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.714758:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3661c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.714774:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.714780:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.714785:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715045:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715056:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715063:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463321.715116:0:5817:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715132:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3661c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715139:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3661c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715161:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3661c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715167:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463321.715173:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3661c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715183:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3661c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715197:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:2.0:1788463321.715201:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463321.715206:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3661c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715220:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee3661c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715232:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715237:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36623 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715242:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715246:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463321.715248:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715252:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36623 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715259:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d0c1e000) 00010000:00010000:2.0:1788463321.715262:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463321.715265:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36623 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715270:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36623 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715286:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715292:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715304:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715308:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463321.715311:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715316:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715324:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0c1e500) 00010000:00010000:2.0:1788463321.715327:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463321.715329:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.715335:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3662a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.718899:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11532:x1875339395548544:12345-192.168.204.11@tcp:34:lfs.0 Request processed in 4286us (8886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.718912:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 188 00000100:00100000:1.0:1788463321.789801:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463321.789857:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395548800 00000100:00100000:1.0:1788463321.789869:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395548800 00000100:00100000:1.0:1788463321.789931:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 189 00000100:00100000:1.0:1788463321.789941:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11535:x1875339395548800:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463321.789965:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463321.789988:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e076 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790085:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36638 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790104:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790135:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790175:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3663f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790183:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3663f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790190:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3663f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790503:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790512:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790519:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463321.790530:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788463321.790879:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790888:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36638 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790895:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790901:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463321.790913:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790922:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36638 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790936:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463321.790939:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463321.790944:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790952:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790963:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3663f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790969:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3663f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790974:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3663f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790979:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463321.790981:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3663f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790986:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3663f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.790994:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d9430800) 00010000:00010000:1.0:1788463321.790997:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463321.791005:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3663f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.791011:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3663f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.791061:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e076 expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.791076:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e076 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.791083:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:1.0:1788463321.791085:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463321.791087:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488000, rc 0) 00000100:00100000:1.0:1788463321.791189:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:11535:x1875339395548800:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1249us (1404us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788463321.791199:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 189 00000100:00100000:1.0:1788463321.797986:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.798472:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395548928 00000100:00100000:2.0:1788463321.798482:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395548928 00000100:00100000:2.0:1788463321.798582:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 190 00000100:00100000:2.0:1788463321.798594:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:11535:x1875339395548928:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:2.0:1788463321.798706:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.798726:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.798748:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.798777:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.798784:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36654 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.798790:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.798795:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463321.798799:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.798807:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36654 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.798833:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:2.0:1788463321.798837:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463321.798842:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36654 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.798849:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.798937:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:11535:x1875339395548928:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 345us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.798945:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 190 00000100:00100000:2.0:1788463321.802640:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.802715:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.802749:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.802776:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.802809:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395549184 00000100:00100000:2.0:1788463321.803415:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395549184 00000100:00100000:2.0:1788463321.803479:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395549312 00000100:00100000:2.0:1788463321.803483:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395549312 00000100:00100000:2.0:1788463321.803518:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 94 00000100:00100000:2.0:1788463321.803528:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395549184:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463321.803772:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395549184:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 96us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.803783:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 94 00000100:00100000:2.0:1788463321.803809:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 95 00000100:00100000:2.0:1788463321.803893:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395549312:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463321.803927:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395549312:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 112us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.803933:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 95 00000100:00100000:2.0:1788463321.803959:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395549056 00000100:00100000:2.0:1788463321.803964:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395549056 00000100:00100000:2.0:1788463321.803994:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 302 00000100:00100000:2.0:1788463321.804001:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2355:x1875339395549056:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463321.804027:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2355:x1875339395549056:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 27us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.804034:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 302 00000100:00080000:2.0:1788463321.804073:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463321.804649:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395549440 00000100:00100000:2.0:1788463321.804666:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395549440 00000100:00100000:2.0:1788463321.804732:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 168 00000100:00100000:2.0:1788463321.804740:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2355:x1875339395549440:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463321.804784:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2355:x1875339395549440:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 45us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.804791:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 168 00000100:00080000:2.0:1788463321.804808:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463321.811188:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.811263:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395549696 00000100:00100000:3.0:1788463321.811273:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395549696 00000100:00100000:3.0:1788463321.811335:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:3.0:1788463321.811348:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+26:11535:x1875339395549696:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463321.811651:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:11535:x1875339395549696:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 304us (474us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788463321.811659:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:2.0:1788463321.855022:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463321.855099:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395549952 00000100:00100000:3.0:1788463321.855115:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395549952 00000100:00100000:3.0:1788463321.855214:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 191 00000100:00100000:3.0:1788463321.855378:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:11069:x1875339395549952:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:3.0:1788463321.855411:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463321.855442:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3665b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e07d expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.855759:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.855780:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e076 expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463321.855817:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.856126:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e076 expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.856158:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e076 expref: 28 pid: 5816 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.856176:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7385880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408129152:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463321.856307:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c3e91c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463321.861781:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7385880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408129152:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463321.861790:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463321.861942:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395550080 00000100:00100000:0.0:1788463321.861952:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395550080 00010000:00010000:0.0:1788463321.862015:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e076 expref: 29 pid: 5816 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463321.862117:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 75 00000100:00100000:0.0:1788463321.862130:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:2354:x1875339395550080:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463321.862165:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463321.862193:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e076 expref: 29 pid: 5816 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.862207:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e076 expref: 29 pid: 5816 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.862236:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee36646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e076 expref: 29 pid: 5816 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.862257:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:0.0:1788463321.862262:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.862273:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.862282:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.862303:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463321.862376:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+28:2354:x1875339395550080:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 248us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463321.862393:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 75 00010000:00010000:2.0:1788463321.863551:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.863568:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.863574:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463321.863595:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788463321.863821:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee3665b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e07d expref: 29 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.863861:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e07d expref: 28 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.863871:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:2.0:1788463321.863875:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463321.863878:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1800, rc 0) 00000100:00100000:2.0:1788463321.863951:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+28:11069:x1875339395549952:12345-192.168.204.11@tcp:101:bash.0 Request processed in 8578us (8944us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788463321.863960:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 191 00000100:00100000:2.0:1788463321.871335:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463321.871598:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395550336 00000100:00100000:0.0:1788463321.871609:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395550336 00000100:00100000:0.0:1788463321.871862:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 192 00000100:00100000:0.0:1788463321.871875:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+28:11069:x1875339395550336:12345-192.168.204.11@tcp:36:bash.0 00010000:00010000:0.0:1788463321.872185:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.872220:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.872233:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463321.872290:0:8863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788463321.872358:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ce4d999 reply state 000000000dd7ed23 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463321.872435:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788463321.872487:0:8863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788463321.872853:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11069:x1875339395550336:12345-192.168.204.11@tcp:36:bash.0 Request processed in 979us (1529us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788463321.872861:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 192 00000020:00080000:0.0:1788463321.872866:0:8863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788463321.880547:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.880570:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.880579:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.880585:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463321.880591:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.880601:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.880645:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:0.0:1788463321.880648:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463321.880654:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463321.880661:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36670 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463321.883281:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463321.883408:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395550464 00000100:00100000:1.0:1788463321.883424:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395550464 00000100:00100000:1.0:1788463321.883507:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 193 00000100:00100000:1.0:1788463321.883518:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:11069:x1875339395550464:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:1.0:1788463321.883543:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463321.883564:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36677 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e084 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.883631:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36677 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e084 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.883673:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36677 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e084 expref: 32 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463321.883742:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:1.0:1788463321.883746:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463321.883751:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489e00, rc 0) 00000100:00100000:1.0:1788463321.883824:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11069:x1875339395550464:12345-192.168.204.11@tcp:101:bash.0 Request processed in 307us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463321.883831:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 193 00000100:00100000:1.0:1788463321.890613:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.890720:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395550592 00000100:00100000:2.0:1788463321.890734:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395550592 00000100:00100000:2.0:1788463321.890805:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:2.0:1788463321.890816:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:11069:x1875339395550592:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1788463321.890837:0:6665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463321.890866:0:6665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007da3555f/0xc3fe72277ee3667e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e08b expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788463321.890909:0:6665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a99c8d8, atime: 0x6a99c8d7, ctime: 0x6a99c8d8, blocks: 0xb 00010000:00010000:2.0:1788463321.890942:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1788463321.890948:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463321.890959:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007da3555f/0xc3fe72277ee3667e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e08b expref: 8 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.891006:0:6665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007da3555f/0xc3fe72277ee3667e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e08b expref: 8 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.891022:0:6665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39400, rc 0) 00000100:00100000:2.0:1788463321.891120:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:11069:x1875339395550592:12345-192.168.204.11@tcp:101:bash.0 Request processed in 305us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463321.891128:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:2.0:1788463321.894660:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463321.896254:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395550720 00000100:00100000:0.0:1788463321.896276:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395550720 00002000:00010000:1.0:1788463321.896550:0:6671:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788463321.896557:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba4c7385c00 with x1875339395550720 ext(0->18446744073709551615) 00002000:00010000:1.0:1788463321.896571:0:6671:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba4c7385c00. 00000100:00100000:1.0:1788463321.896717:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:1.0:1788463321.896733:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2354:x1875339395550720:12345-192.168.204.11@tcp:10:bash.0 00002000:00010000:1.0:1788463321.897111:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788463321.897116:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788463320 -> 1788463322 00002000:00010000:1.0:1788463321.897119:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788463319 -> 1788463319 00002000:00010000:1.0:1788463321.897122:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788463320 -> 1788463322 00002000:00010000:1.0:1788463321.897124:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788463321.897223:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2354:x1875339395550720:12345-192.168.204.11@tcp:10:bash.0 Request processed in 491us (2573us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788463321.897230:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00002000:00010000:1.0:1788463321.897235:0:6671:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788463321.897258:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba4c7385c00 with x1875339395550720 ext(0->18446744073709551615) 00002000:00010000:1.0:1788463321.897264:0:6671:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba4c7385c00. 00010000:00010000:0.0:1788463321.957025:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463321.984624:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463321.984747:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395550848 00000100:00100000:2.0:1788463321.984759:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395550848 00000100:00100000:2.0:1788463321.984840:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 194 00000100:00100000:2.0:1788463321.984850:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11549:x1875339395550848:12345-192.168.204.11@tcp:34:lfs.0 00010000:00010000:2.0:1788463321.984930:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36685 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.984948:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.984961:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.984977:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3668c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.984984:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3668c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985011:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3668c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985264:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985274:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985281:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463321.985323:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985335:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985342:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36685 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985349:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985355:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463321.985372:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985381:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36685 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985393:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:2.0:1788463321.985402:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463321.985408:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985416:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee36685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985430:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3668c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.985436:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3668c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987797:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3668c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987809:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463321.987814:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3668c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987832:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3668c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987849:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463321.987852:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463321.987857:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3668c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987864:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee3668c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987892:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987919:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987925:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987930:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463321.987933:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987939:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987947:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:2.0:1788463321.987950:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463321.987953:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463321.987958:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463321.988376:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11549:x1875339395550848:12345-192.168.204.11@tcp:34:lfs.0 Request processed in 3512us (4006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463321.988387:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 194 00000100:00100000:0.0:1788463322.026090:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463322.026198:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395551104 00000100:00100000:2.0:1788463322.026211:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395551104 00000100:00100000:2.0:1788463322.026304:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 195 00000100:00100000:2.0:1788463322.026316:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11552:x1875339395551104:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463322.026342:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463322.026380:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee3669a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e092 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.026940:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee366a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.026980:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee366a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.026997:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee366a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.027021:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee366a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.027028:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee366a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.027035:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee366a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028204:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee366af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028217:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee366af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028228:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee366af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463322.028240:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788463322.028348:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee366a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028356:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee366a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028375:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee366a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028388:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463322.028393:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee366a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028401:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee366a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028415:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:2.0:1788463322.028418:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463322.028423:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee366a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028429:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee366a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788463322.028789:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788463322.028962:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee366a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028969:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee366a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028975:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee366a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028979:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463322.028982:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee366a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.028988:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee366a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.029008:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463322.029011:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463322.029014:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee366a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.029019:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee366a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.029078:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee3669a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e092 expref: 35 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.029093:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee366af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e092 expref: 34 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.029101:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:2.0:1788463322.029103:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788463322.029106:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38a00, rc 0) 00000100:00100000:2.0:1788463322.029199:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:11552:x1875339395551104:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 2884us (3120us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788463322.029207:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 195 00000100:00100000:2.0:1788463322.035120:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463322.035243:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395551232 00000100:00100000:0.0:1788463322.035255:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395551232 00000100:00100000:0.0:1788463322.035334:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 196 00000100:00100000:0.0:1788463322.035347:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:11552:x1875339395551232:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:0.0:1788463322.035461:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.035481:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e07d expref: 34 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.035501:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.035544:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e07d expref: 34 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.035585:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e07d expref: 34 pid: 8864 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463322.035602:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408129280:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463322.035924:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463322.041203:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408129280:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463322.041245:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463322.049625:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463322.050091:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395551488 00000100:00100000:3.0:1788463322.050108:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395551488 00000100:00100000:3.0:1788463322.050196:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:3.0:1788463322.050209:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:5594:x1875339395551488:12345-192.168.204.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788463322.050945:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+36:5594:x1875339395551488:12345-192.168.204.11@tcp:35:ldlm_bl.0 Request processed in 734us (1343us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788463322.050954:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:2.0:1788463322.055886:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463322.056733:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395551616 00000100:00100000:3.0:1788463322.056749:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395551616 00010000:00010000:3.0:1788463322.056810:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e07d expref: 36 pid: 8864 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463322.056873:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 76 00000100:00100000:3.0:1788463322.056885:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+36:2354:x1875339395551616:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463322.056909:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463322.056919:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e07d expref: 36 pid: 8864 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.056961:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e07d expref: 36 pid: 8864 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.056992:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36662 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e07d expref: 36 pid: 8864 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.057015:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:3.0:1788463322.057020:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.057032:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.057042:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.057091:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463322.057183:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:2354:x1875339395551616:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 299us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463322.057191:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 76 00010000:00010000:0.0:1788463322.057757:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.057767:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.057806:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.057813:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.057820:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.057826:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463322.057831:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.057840:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.057865:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:0.0:1788463322.057868:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788463322.057872:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.057878:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee366bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463322.057939:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:11552:x1875339395551232:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 22594us (22834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463322.057948:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 196 00000100:00100000:2.0:1788463322.065065:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463322.065165:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395551872 00000100:00100000:3.0:1788463322.065175:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395551872 00000100:00100000:3.0:1788463322.065234:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:3.0:1788463322.065245:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+34:11552:x1875339395551872:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463322.065527:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:11552:x1875339395551872:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 284us (473us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788463322.065534:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:2.0:1788463322.203270:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463322.204630:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395552128 00000100:00100000:3.0:1788463322.204645:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395552128 00000100:00100000:3.0:1788463322.204822:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 197 00000100:00100000:3.0:1788463322.204834:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+35:11563:x1875339395552128:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:3.0:1788463322.204872:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463322.204899:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e099 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.205010:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.205028:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.205043:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.205058:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.205066:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.205072:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.205898:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee366d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.205913:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee366d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.205939:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee366d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463322.206012:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788463322.208025:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208043:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208051:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208057:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463322.208063:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208072:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208093:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:3.0:1788463322.208096:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463322.208103:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208109:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208129:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208616:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208651:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208657:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463322.208660:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208667:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208786:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d0217900) 00010000:00010000:3.0:1788463322.208789:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463322.208793:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.208798:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.209074:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e099 expref: 38 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.209092:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee366d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e099 expref: 37 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.209100:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:3.0:1788463322.209102:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463322.209104:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0600, rc 0) 00000100:00100000:3.0:1788463322.209319:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:11563:x1875339395552128:12345-192.168.204.11@tcp:101:cat.0 Request processed in 4485us (6060us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788463322.209337:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 197 00000100:00100000:3.0:1788463322.221969:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463322.222294:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395552384 00000100:00100000:1.0:1788463322.222305:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395552384 00000100:00100000:1.0:1788463322.222378:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 54 00000100:00100000:1.0:1788463322.222390:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:11563:x1875339395552384:12345-192.168.204.11@tcp:35:cat.0 00000100:00100000:1.0:1788463322.222717:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:11563:x1875339395552384:12345-192.168.204.11@tcp:35:cat.0 Request processed in 329us (768us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788463322.222724:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 54 00000001:00080000:2.0:1788463322.243515:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1788463322.244674:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1788463322.262611:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463322.264354:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395552640 00000100:00100000:0.0:1788463322.264369:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395552640 00000100:00100000:3.0:1788463322.268126:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 198 00000100:00100000:3.0:1788463322.268150:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:11564:x1875339395552640:12345-192.168.204.11@tcp:36:rm.0 00010000:00010000:3.0:1788463322.268227:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788463322.268256:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee366d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e099 expref: 38 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268280:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee366af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e092 expref: 37 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268296:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36677 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e084 expref: 36 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268307:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d9430600) 00010000:00010000:3.0:1788463322.268318:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463322.268342:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268357:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268367:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268381:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268405:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268413:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268957:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268967:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.268974:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463322.269912:0:8863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788463322.269922:0:8863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353880237110ns, next at 354880234803ns, rc = 0 00010000:00010000:3.0:1788463322.269986:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.269998:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270007:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270014:0:8863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270019:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270035:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270176:0:8863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463322.270199:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270206:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366f5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270274:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270280:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463322.270284:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270292:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366f5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270303:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0217400) 00010000:00010000:3.0:1788463322.270306:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788463322.270310:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366f5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270316:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee366f5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270333:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270338:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270350:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270355:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463322.270358:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270364:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270372:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:3.0:1788463322.270375:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463322.270378:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.270383:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee366e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463322.270393:0:8863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050d4eb40 reply state 0000000034259add transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463322.270402:0:8863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463322.270855:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+37:11564:x1875339395552640:12345-192.168.204.11@tcp:36:rm.0 Request processed in 2704us (8253us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788463322.270865:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 198 00010000:00010000:0.0:1788463322.276198:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463322.276321:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.276334:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463322.276339:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.276350:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.276370:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ba5d0217400) 00010000:00010000:0.0:1788463322.276373:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788463322.276379:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.276386:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee366fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.276431:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463322.276433:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463322.276435:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463322.290660:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.290680:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.290723:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.290729:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463322.290735:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.290744:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.290765:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d0217900) 00010000:00010000:0.0:1788463322.290768:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463322.290774:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.290781:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee366ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463322.350553:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463322.350668:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395552896 00000100:00100000:0.0:1788463322.350679:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395552896 00000100:00100000:0.0:1788463322.350880:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 199 00000100:00100000:0.0:1788463322.350891:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+36:11570:x1875339395552896:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:0.0:1788463322.350934:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463322.350955:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36703 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0a0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.351093:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3670a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.351116:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3670a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.351143:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3670a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.351168:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.351179:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.351190:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788463322.351899:0:5818:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788463322.352144:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352165:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352182:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352261:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3670a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352269:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3670a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352276:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3670a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352282:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463322.352287:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3670a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352294:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3670a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352307:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:0.0:1788463322.352310:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463322.352314:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3670a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352321:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3670a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788463322.352337:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059b189c1 reply state 0000000082451646 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463322.352350:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788463322.352409:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36703 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a0 expref: 39 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352463:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a0 expref: 38 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.352476:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:0.0:1788463322.352480:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463322.352483:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e200, rc 0) 00000100:00100000:0.0:1788463322.352612:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+39:11570:x1875339395552896:12345-192.168.204.11@tcp:101:bash.0 Request processed in 1722us (2070us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788463322.352621:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 199 00010000:00010000:1.0:1788463322.362306:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.362332:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.362343:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.362352:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463322.362361:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.362372:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.362396:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5c519a200) 00010000:00010000:1.0:1788463322.362401:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463322.362408:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.362442:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36711 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463322.364051:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463322.373950:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395553024 00000100:00100000:1.0:1788463322.373978:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395553024 00000100:00100000:1.0:1788463322.374162:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:1.0:1788463322.374174:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2357:x1875339395553024:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:1.0:1788463322.374198:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463322.374231:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36726 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0a7 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463322.374259:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463322.374281:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1788463322.374286:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463322.374296:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36726 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a7 expref: 6 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.374316:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36726 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a7 expref: 6 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.374330:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489e00, rc 0) 00000100:00100000:1.0:1788463322.374418:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395553024:12345-192.168.204.11@tcp:101:bash.0 Request processed in 247us (10375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463322.374425:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:3.0:1788463322.386620:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463322.386716:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395553152 00000100:00100000:3.0:1788463322.386745:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395553152 00000100:00100000:3.0:1788463322.386828:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:3.0:1788463322.386844:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c845f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:11570:x1875339395553152:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:3.0:1788463322.386880:0:6665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463322.386901:0:6665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0ae expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.386944:0:6665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36726 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a7 expref: 7 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.386955:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463322.386959:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463322.386965:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 7 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.387018:0:6665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36726 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a7 expref: 7 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.387044:0:6665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36726 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a7 expref: 7 pid: 6667 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463322.387577:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec5f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6665:1875339408129408:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463322.387717:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463322.397321:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec5f8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6665:1875339408129408:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463322.397381:0:6665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 7 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.397417:0:6665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1800, rc 0) 00000100:00100000:2.0:1788463322.397512:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c845f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:11570:x1875339395553152:12345-192.168.204.11@tcp:101:bash.0 Request processed in 10673us (11310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463322.398195:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:3.0:1788463322.399274:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463322.399345:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395553280 00000100:00100000:2.0:1788463322.399357:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395553280 00010000:00010000:2.0:1788463322.399401:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36726 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a7 expref: 7 pid: 6667 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463322.399447:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00100000:2.0:1788463322.399457:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395553280:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463322.399470:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463322.399494:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36726 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a7 expref: 7 pid: 6667 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.399509:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36726 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a7 expref: 7 pid: 6667 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.399546:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36726 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a7 expref: 7 pid: 6667 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.399586:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788463322.399591:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463322.399600:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 6 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.399610:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 6 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.399651:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 6 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463322.399665:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5803:1875339408129536:192.168.204.11@tcp:105: 00000100:00100000:2.0:1788463322.399766:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463322.407904:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5803:1875339408129536:192.168.204.11@tcp:105: 00010000:00010000:2.0:1788463322.407937:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463322.407996:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2355:x1875339395553280:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 8539us (8770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463322.408008:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 77 00000100:00100000:3.0:1788463322.408090:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463322.408150:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395553536 00000100:00100000:2.0:1788463322.408157:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395553536 00000100:00100000:2.0:1788463322.408201:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 55 00000100:00100000:2.0:1788463322.408219:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+38:11570:x1875339395553536:12345-192.168.204.11@tcp:35:bash.0 00000100:00100000:2.0:1788463322.408549:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+39:11570:x1875339395553536:12345-192.168.204.11@tcp:35:bash.0 Request processed in 330us (459us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788463322.408573:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 55 00000040:00080000:2.0:1788463322.534182:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463322.534196:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463322.534234:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788463322.534246:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788463322.663425:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463322.663745:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395553664 00000100:00100000:1.0:1788463322.663759:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395553664 00000100:00100000:1.0:1788463322.663828:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 200 00000100:00100000:1.0:1788463322.663840:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+39:11586:x1875339395553664:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463322.663877:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463322.663901:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0b5 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.663973:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee3673b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.663988:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee3673b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.664001:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee3673b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463322.664034:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788463322.664038:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463322.664056:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee3673b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.664080:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0b5 expref: 41 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.664100:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee3673b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0b5 expref: 40 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.664110:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463322.664113:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463322.664117:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488000, rc 0) 00000100:00100000:1.0:1788463322.664187:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+40:11586:x1875339395553664:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 349us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463322.664200:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 200 00000100:00100000:0.0:1788463322.674443:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463322.674587:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395553920 00000100:00100000:3.0:1788463322.674598:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395553920 00000100:00100000:3.0:1788463322.674675:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 201 00000100:00100000:3.0:1788463322.674717:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+40:11586:x1875339395553920:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463322.674739:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463322.674761:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36742 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0bc expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.675073:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.675088:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.675102:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463322.675115:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788463322.675413:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36742 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0bc expref: 43 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.675435:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0bc expref: 42 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.675443:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:3.0:1788463322.675446:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463322.675450:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1600, rc 0) 00000100:00100000:3.0:1788463322.676032:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+42:11586:x1875339395553920:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1344us (1598us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788463322.676065:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 201 00000100:00100000:3.0:1788463322.684321:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463322.684464:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395554176 00000100:00100000:0.0:1788463322.684474:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395554176 00000100:00100000:0.0:1788463322.684537:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 202 00000100:00100000:0.0:1788463322.684548:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+42:11586:x1875339395554176:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463322.684571:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463322.684593:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36757 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0c3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.684734:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3675e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.684751:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3675e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.684765:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3675e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463322.684798:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788463322.684934:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36757 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0c3 expref: 45 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.684955:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3675e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0c3 expref: 44 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.684965:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:0.0:1788463322.684968:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788463322.684972:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710fa00, rc 0) 00000100:00100000:0.0:1788463322.685031:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+44:11586:x1875339395554176:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 485us (722us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788463322.685039:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 202 00000100:00100000:2.0:1788463322.690114:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463322.690249:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395554304 00000100:00100000:1.0:1788463322.690261:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395554304 00000100:00100000:1.0:1788463322.690345:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:1.0:1788463322.690356:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+44:2354:x1875339395554304:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463322.690375:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463322.690407:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0bc expref: 44 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.690433:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:1.0:1788463322.690442:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463322.690580:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+43:2354:x1875339395554304:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 221us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463322.690595:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:2.0:1788463322.705673:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463322.705972:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395554432 00000100:00100000:0.0:1788463322.705983:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395554432 00000100:00100000:0.0:1788463322.706053:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:0.0:1788463322.706065:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+6:2357:x1875339395554432:12345-192.168.204.11@tcp:1:lfs.0 00010000:00010000:0.0:1788463322.706113:0:8660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.706148:0:8660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 6 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.706157:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463322.706162:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463322.706167:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.706788:0:8660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 6 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.706816:0:8660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 6 pid: 6665 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463322.707533:0:8660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8660:1875339408129664:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463322.707837:0:8660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c1086480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463322.722988:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463322.724420:0:8660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8660:1875339408129664:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463322.724470:0:8660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463322.724973:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395554560 00000100:00100000:1.0:1788463322.724988:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395554560 00002000:00100000:1.0:1788463322.725080:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ba4c7384000 x1875339395554560/t0(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:458/0 lens 504/0 e 0 to 0 dl 1788463333 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463322.725091:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba4c7384000 with x1875339395554560 ext(0->8) 00010000:00010000:1.0:1788463322.725100:0:6672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 7 pid: 6665 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.725116:0:6672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 7 pid: 6665 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463322.725190:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ba4c7384000 00000100:00100000:1.0:1788463322.725387:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:1.0:1788463322.725406:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395554560:12345-192.168.204.11@tcp:4:lfs.0 00000100:00100000:1.0:1788463322.726119:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2354:x1875339395554560:12345-192.168.204.11@tcp:4:lfs.0 Request processed in 715us (3136us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788463322.726141:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00002000:00100000:1.0:1788463322.726150:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ba4c7384000 x1875339395554560/t4294967308(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:458/0 lens 504/448 e 0 to 0 dl 1788463333 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463322.726160:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba4c7384000 with x1875339395554560 ext(0->8) 00010000:00010000:1.0:1788463322.726173:0:6672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 9 pid: 6665 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.726195:0:6672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 9 pid: 6665 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463322.726224:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ba4c7384000 00000100:00100000:2.0:1788463322.732887:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463322.733165:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395554688 00000100:00100000:0.0:1788463322.733245:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395554688 00010000:00010000:0.0:1788463322.733290:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 9 pid: 6665 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463322.733376:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 78 00000100:00100000:0.0:1788463322.733387:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2355:x1875339395554688:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463322.733404:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788463322.733424:0:8442:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788463322.733426:0:8442:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788463322 00002000:00010000:0.0:1788463322.733428:0:8442:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788463323 00002000:00010000:0.0:1788463322.733430:0:8442:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788463322 00010000:00010000:0.0:1788463322.733453:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 9 pid: 6665 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.733468:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 9 pid: 6665 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.733494:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd32285/0xc3fe72277ee3672d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ae expref: 9 pid: 6665 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.733512:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463322.733516:0:8442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788463322.733522:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.733533:0:8442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.733572:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463322.733647:0:8660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463322.733654:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395554688:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 268us (777us total) trans 0 rc 0/0 00010000:00010000:1.0:1788463322.733665:0:8660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463322.733670:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 78 00010000:00010000:1.0:1788463322.733712:0:8660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.733722:0:8660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.734009:0:8660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.734016:0:8660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463322.734020:0:8660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.734030:0:8660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.734044:0:8660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.734050:0:8660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046185fac/0xc3fe72277ee3676c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463322.734102:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2357:x1875339395554432:12345-192.168.204.11@tcp:1:lfs.0 Request processed in 28039us (28441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463322.734111:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:3.0:1788463322.738598:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463322.739015:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395554944 00000100:00100000:1.0:1788463322.739032:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395554944 00000100:00100000:1.0:1788463322.739109:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 56 00000100:00100000:1.0:1788463322.739122:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+43:11586:x1875339395554944:12345-192.168.204.11@tcp:35:lfs.0 00000004:00010000:1.0:1788463322.739241:0:5819:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3675e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0c3 expref: 43 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463322.739538:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788463322.739587:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788463322.740411:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788463322.740483:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.740502:0:5819:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a0 expref: 47 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.740530:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.740572:0:5819:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a0 expref: 47 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.740943:0:5819:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a0 expref: 47 pid: 5818 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463322.740961:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5819:1875339408129792:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463322.741344:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c1086b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463322.748871:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5819:1875339408129792:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463322.748915:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00010000:00010000:0.0:1788463322.748918:0:5819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463322.749018:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395555072 00000100:00100000:1.0:1788463322.749032:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395555072 00010000:00010000:1.0:1788463322.749083:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a0 expref: 48 pid: 5818 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463322.749137:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 79 00000100:00100000:1.0:1788463322.749155:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+48:2355:x1875339395555072:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463322.749182:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463322.749195:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a0 expref: 48 pid: 5818 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.749234:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a0 expref: 48 pid: 5818 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.749269:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0a0 expref: 48 pid: 5818 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.749303:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:1.0:1788463322.749312:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.749328:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.749342:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463322.749412:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463322.749523:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+47:2355:x1875339395555072:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 374us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463322.749531:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 79 00010000:00010000:0.0:1788463322.749564:0:5819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.749573:0:5819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463322.749761:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788463322.750284:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788463322.750423:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408129920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788463322.750486:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463322.750523:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c1086e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463322.750705:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408129920 00000100:00100000:1.0:1788463322.750713:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408129920 00000100:00100000:1.0:1788463322.750801:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463322.750816:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1875339408129920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788463322.750922:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788463322.750955:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1875339408129920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463322.750963:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463322.750988:0:5819:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1788463322.750995:0:5819:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1788463322.751017:0:5819:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5fe9c8a80, transno 4294967307 00000100:00100000:0.0:1788463322.751036:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408129920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788463322.751627:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788463322.751728:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408130048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788463322.751771:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463322.751794:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c1086b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463322.753330:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408130048 00000100:00100000:1.0:1788463322.753347:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408130048 00000100:00100000:1.0:1788463322.753415:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463322.753425:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5819:x1875339408130048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788463322.754377:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5819:x1875339408130048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 951us (2602us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788463322.754387:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788463322.754488:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed61880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5819:1875339408130048:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788463322.754568:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788463322.754637:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.754648:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.754656:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.754661:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463322.754666:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.754674:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.754716:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:2.0:1788463322.754719:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788463322.754743:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463322.754752:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36773 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788463322.755175:0:5819:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788463322.755414:0:5819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788463322.755428:0:5819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354365742658ns, next at 355365740547ns, rc = 0 00000001:00080000:2.0:1788463322.755435:0:5819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788463322.755476:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519aa00) 00010000:00010000:2.0:1788463322.755480:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788463322.755488:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3675e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0c3 expref: 51 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463322.759420:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05a4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:11586:x1875339395554944:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 20275us (20813us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788463322.759446:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 56 00000020:00080000:2.0:1788463322.759462:0:5819:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788463322.764359:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463322.764645:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395555200 00000100:00100000:0.0:1788463322.764657:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395555200 00000100:00100000:0.0:1788463322.764765:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 203 00000100:00100000:0.0:1788463322.764777:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+50:11586:x1875339395555200:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463322.764803:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463322.764825:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3677a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0ca expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.764888:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3677a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ca expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.764904:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3677a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ca expref: 51 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463322.764924:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:0.0:1788463322.764927:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463322.764931:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f800, rc 0) 00000100:00100000:0.0:1788463322.765003:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+51:11586:x1875339395555200:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 228us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463322.765030:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 203 00000100:00100000:3.0:1788463322.776820:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463322.777360:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395555456 00000100:00100000:1.0:1788463322.777375:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395555456 00000100:00100000:1.0:1788463322.777446:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:1.0:1788463322.777457:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+51:11586:x1875339395555456:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:0.0:1788463322.780049:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:11586:x1875339395555456:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 2581us (3226us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788463322.780066:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 57 00000100:00100000:2.0:1788463322.951944:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463322.954975:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395555584 00000100:00100000:3.0:1788463322.954991:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395555584 00000100:00100000:3.0:1788463322.955147:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 204 00000100:00100000:3.0:1788463322.955159:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:11597:x1875339395555584:12345-192.168.204.11@tcp:34:lfs.0 00010000:00010000:3.0:1788463322.955246:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36781 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955266:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955279:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955294:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36788 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955302:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955308:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955410:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955435:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955441:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788463322.955483:0:8863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955497:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955503:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36781 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955509:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36781 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955516:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463322.955519:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36781 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955527:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36781 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955539:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:3.0:1788463322.955542:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463322.955546:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955553:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955573:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955578:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36788 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955584:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955588:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463322.955590:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955596:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36788 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955603:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d0217100) 00010000:00010000:3.0:1788463322.955605:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463322.955622:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36788 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955627:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36788 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955641:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955647:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955653:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955663:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463322.955666:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955672:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955679:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:3.0:1788463322.955681:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463322.955732:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463322.955738:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee3678f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463322.955837:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:11597:x1875339395555584:12345-192.168.204.11@tcp:34:lfs.0 Request processed in 677us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463322.955845:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 204 00010000:00010000:2.0:1788463322.981107:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463323.030981:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.031114:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395555840 00000100:00100000:1.0:1788463323.031146:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395555840 00000100:00100000:1.0:1788463323.031232:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 205 00000100:00100000:1.0:1788463323.031243:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+52:11600:x1875339395555840:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463323.031288:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463323.031311:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0d1 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.031439:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3679d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.031461:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3679d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.031476:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3679d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.031679:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee367a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.031731:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee367a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.031739:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee367a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.031921:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee367ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.031930:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee367ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.031938:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee367ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463323.031950:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788463323.032077:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3679d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032085:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3679d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032092:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3679d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032098:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463323.032103:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3679d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032111:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3679d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032135:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463323.032139:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463323.032144:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3679d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032151:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee3679d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032167:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee367a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032173:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee367a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032181:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee367a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032186:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463323.032195:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee367a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032202:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee367a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032210:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d9430800) 00010000:00010000:1.0:1788463323.032213:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463323.032215:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee367a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032221:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee367a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032267:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee36796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0d1 expref: 55 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032281:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee367ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0d1 expref: 54 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.032288:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463323.032290:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463323.032293:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf6600, rc 0) 00000100:00100000:1.0:1788463323.033053:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:11600:x1875339395555840:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 1802us (2073us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788463323.033064:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 205 00000100:00100000:2.0:1788463323.044380:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.044458:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395555968 00000100:00100000:0.0:1788463323.044476:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395555968 00000100:00100000:0.0:1788463323.044554:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 206 00000100:00100000:0.0:1788463323.044567:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:11600:x1875339395555968:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:0.0:1788463323.044659:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee367b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.044679:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee367b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.044741:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee367b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.044778:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee367b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.044785:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee367b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.044794:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee367b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.044801:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463323.044807:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee367b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.044833:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee367b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.044848:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:0.0:1788463323.044851:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788463323.044857:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee367b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.044863:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee367b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463323.044951:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:11600:x1875339395555968:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 387us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463323.044958:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 206 00000100:00100000:2.0:1788463323.050446:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.050740:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395556224 00000100:00100000:0.0:1788463323.050753:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395556224 00000100:00100000:0.0:1788463323.050832:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:0.0:1788463323.050844:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+54:11600:x1875339395556224:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:0.0:1788463323.051136:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:11600:x1875339395556224:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 294us (703us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788463323.051146:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 58 00000100:00100000:3.0:1788463323.238164:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463323.240652:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395556480 00000100:00100000:2.0:1788463323.240672:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395556480 00000100:00100000:3.0:1788463323.241251:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 207 00000100:00100000:3.0:1788463323.241268:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:11610:x1875339395556480:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:3.0:1788463323.241300:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463323.241305:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788463323.241404:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488000/0xc3fe72277ee3673b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0b5 expref: 55 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.241434:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:3.0:1788463323.241458:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788463323.241476:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee367c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0d8 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.241618:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee367c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.241635:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee367c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.241646:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee367c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463323.241659:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788463323.241967:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee367c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0d8 expref: 57 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.241985:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee367c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0d8 expref: 56 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.241994:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:3.0:1788463323.241998:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463323.242002:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0600, rc 0) 00000100:00100000:3.0:1788463323.242100:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:11610:x1875339395556480:12345-192.168.204.11@tcp:101:bash.0 Request processed in 835us (3955us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788463323.242108:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 207 00000100:00100000:2.0:1788463323.249064:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463323.249213:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395556608 00000100:00100000:3.0:1788463323.249227:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395556608 00000100:00100000:0.0:1788463323.249639:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:0.0:1788463323.249654:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:2355:x1875339395556608:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463323.249675:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463323.249773:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee367c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0d8 expref: 56 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.249826:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:0.0:1788463323.249833:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463323.249912:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:2355:x1875339395556608:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 262us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463323.249920:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:2.0:1788463323.252354:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.260376:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395556864 00000100:00100000:1.0:1788463323.260403:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395556864 00000100:00100000:1.0:1788463323.261633:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 208 00000100:00100000:1.0:1788463323.261653:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+55:11610:x1875339395556864:12345-192.168.204.11@tcp:36:bash.0 00010000:00010000:1.0:1788463323.261769:0:8864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463323.261809:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee367ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0d1 expref: 55 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.261836:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463323.261842:0:8864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463323.262095:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.262112:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.262134:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788463323.262189:0:8864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788463323.262217:0:8864:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c49b3064 reply state 00000000f17023c1 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463323.262227:0:8864:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463323.262354:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:11610:x1875339395556864:12345-192.168.204.11@tcp:36:bash.0 Request processed in 708us (10078us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788463323.262361:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 208 00000020:00080000:1.0:1788463323.262367:0:8864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788463323.266220:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.266247:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.266257:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.266263:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf7400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463323.266270:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.266353:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.266380:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:0.0:1788463323.266384:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463323.266391:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.266399:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7400/0xc3fe72277ee367d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.276384:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.276664:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395556992 00000100:00100000:1.0:1788463323.276676:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395556992 00000100:00100000:0.0:1788463323.281959:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 209 00000100:00100000:0.0:1788463323.281991:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+56:11610:x1875339395556992:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:0.0:1788463323.282021:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463323.282048:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee367dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0df expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.282181:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.282201:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.282218:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463323.282251:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788463323.282255:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463323.282277:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.282307:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee367dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0df expref: 58 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.282333:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0df expref: 57 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.282342:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:0.0:1788463323.282345:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788463323.282349:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e200, rc 0) 00000100:00100000:0.0:1788463323.282442:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:11610:x1875339395556992:12345-192.168.204.11@tcp:101:bash.0 Request processed in 454us (6073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463323.282461:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 209 00000100:00100000:2.0:1788463323.288253:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.288352:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395557248 00000100:00100000:0.0:1788463323.288364:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395557248 00000100:00100000:0.0:1788463323.288435:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:0.0:1788463323.288448:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+57:11610:x1875339395557248:12345-192.168.204.11@tcp:35:bash.0 00000100:00100000:0.0:1788463323.288829:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+58:11610:x1875339395557248:12345-192.168.204.11@tcp:35:bash.0 Request processed in 383us (586us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788463323.288838:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 59 00000100:00100000:3.0:1788463323.373455:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.380733:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395557376 00000100:00100000:0.0:1788463323.380754:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395557376 00000100:00100000:0.0:1788463323.380845:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 210 00000100:00100000:0.0:1788463323.381258:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+58:11616:x1875339395557376:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463323.381299:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463323.381322:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee367ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0e6 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.381426:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee367f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.381450:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee367f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.381466:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee367f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463323.381518:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788463323.381523:0:8863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463323.381575:0:8863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee367f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.381608:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee367ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0e6 expref: 60 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.381632:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee367f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0e6 expref: 59 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.381642:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:0.0:1788463323.381645:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463323.381650:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f400, rc 0) 00000100:00100000:0.0:1788463323.381809:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:11616:x1875339395557376:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 556us (8367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463323.381818:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 210 00000100:00100000:2.0:1788463323.387094:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.387397:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395557504 00000100:00100000:1.0:1788463323.387408:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395557504 00000100:00100000:1.0:1788463323.387573:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 211 00000100:00100000:1.0:1788463323.387587:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:11616:x1875339395557504:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463323.387624:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463323.387656:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee367f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0ed expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.387780:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee367ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.387803:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee367ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.387820:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee367ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.387839:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.387859:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.387868:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.388614:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee3680d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.388628:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee3680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.388637:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee3680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463323.389017:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788463323.389041:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463323.389832:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee3680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.389864:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee3680d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.389877:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee367ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390010:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee367ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390020:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee367ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390028:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf7000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463323.390035:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee367ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390044:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee367ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390064:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463323.390067:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463323.390074:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee367ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390081:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee367ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390104:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390208:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36806 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390214:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390219:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf7a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463323.390223:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390230:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390239:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5d9430000) 00010000:00010000:1.0:1788463323.390242:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463323.390245:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36806 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390252:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390306:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee367f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ed expref: 61 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390324:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee3680d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ed expref: 60 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.390332:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463323.390335:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463323.390345:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf6e00, rc 0) 00000100:00100000:1.0:1788463323.390442:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:11616:x1875339395557504:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 2857us (3363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.390452:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 211 00000100:00100000:2.0:1788463323.398996:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.399228:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395557632 00000100:00100000:1.0:1788463323.399238:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395557632 00000100:00100000:1.0:1788463323.399313:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:1.0:1788463323.399322:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:2355:x1875339395557632:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463323.399587:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463323.399616:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee3680d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ed expref: 60 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.399639:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463323.399645:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463323.399860:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:2355:x1875339395557632:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 538us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.399868:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:2.0:1788463323.407062:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.407202:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395557888 00000100:00100000:0.0:1788463323.407216:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395557888 00000100:00100000:0.0:1788463323.407451:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 212 00000100:00100000:0.0:1788463323.407466:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:11616:x1875339395557888:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463323.407495:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463323.407527:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0f4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.407656:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.407674:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0df expref: 60 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.410242:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.410321:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0df expref: 60 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.410340:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0df expref: 60 pid: 5818 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463323.410363:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fec58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408130176:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463323.413039:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba4c1086180 going to sleep for 11 seconds 00000100:00100000:2.0:1788463323.418870:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.420046:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fec58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5818:1875339408130176:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463323.420086:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463323.421631:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395558016 00000100:00100000:1.0:1788463323.421647:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395558016 00010000:00010000:1.0:1788463323.421718:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0df expref: 61 pid: 5818 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463323.421767:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 80 00000100:00100000:1.0:1788463323.421779:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:2354:x1875339395558016:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463323.421798:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463323.421805:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0df expref: 61 pid: 5818 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.421840:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0df expref: 61 pid: 5818 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.421866:0:8442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee367e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0df expref: 61 pid: 5818 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.421896:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463323.421901:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.421912:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.421920:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.422315:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463323.422384:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:2354:x1875339395558016:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 606us (3529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.422392:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 80 00010000:00010000:0.0:1788463323.424821:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.424838:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463323.424861:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788463323.425650:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee36814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0f4 expref: 61 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.425733:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0f4 expref: 60 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.425746:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463323.425772:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788463323.425778:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710fa00, rc 0) 00000100:00100000:1.0:1788463323.426037:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:11616:x1875339395557888:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 18571us (18985us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788463323.426049:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 212 00000100:00100000:2.0:1788463323.431293:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463323.431440:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395558272 00000100:00100000:3.0:1788463323.431478:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395558272 00000100:00100000:3.0:1788463323.431580:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:3.0:1788463323.431591:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:11616:x1875339395558272:12345-192.168.204.11@tcp:103:lfs.0 00010000:00010000:3.0:1788463323.431610:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463323.431640:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee3677a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0ca expref: 60 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.431664:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:3.0:1788463323.431670:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463323.431769:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:11616:x1875339395558272:12345-192.168.204.11@tcp:103:lfs.0 Request processed in 180us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463323.431779:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:2.0:1788463323.435556:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.435756:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395558400 00000100:00100000:0.0:1788463323.435769:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395558400 00000100:00100000:0.0:1788463323.435922:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 213 00000100:00100000:0.0:1788463323.435935:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:11616:x1875339395558400:12345-192.168.204.11@tcp:58:lfs.0 00010000:00010000:0.0:1788463323.436134:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.436167:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.436183:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788463323.436415:0:8863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788463323.437092:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:11616:x1875339395558400:12345-192.168.204.11@tcp:58:lfs.0 Request processed in 1153us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463323.437102:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 213 00000100:00100000:3.0:1788463323.439724:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.439881:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395558528 00000100:00100000:1.0:1788463323.439906:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395558528 00000100:00100000:1.0:1788463323.440001:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 214 00000100:00100000:1.0:1788463323.440014:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+59:11616:x1875339395558528:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463323.440041:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463323.440072:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee36830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e0fb expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.440167:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.440181:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee36830 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0fb expref: 60 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.440206:0:8864:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.440221:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee36830 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0fb expref: 60 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.440239:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463323.440242:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463323.440245:0:8864:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee36830 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0fb expref: 60 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.440272:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf6e00, rc 0) 00000100:00100000:1.0:1788463323.440341:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:11616:x1875339395558528:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 329us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.440349:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 214 00000040:00080000:2.0:1788463323.557135:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463323.557151:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463323.557220:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788463323.557231:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788463323.557383:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f7d35500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408130304:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788463323.557738:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c3e91c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463323.561519:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f7d35500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408130304:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788463323.562337:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.562489:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395558656 00000100:00100000:1.0:1788463323.562499:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395558656 00000100:00100000:1.0:1788463323.562561:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 215 00000100:00100000:1.0:1788463323.562572:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:11617:x1875339395558656:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788463323.562855:0:5818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788463323.562995:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:11617:x1875339395558656:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 424us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.563004:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 215 00000100:00100000:2.0:1788463323.565283:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.565409:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395558784 00000100:00100000:1.0:1788463323.565423:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395558784 00000100:00100000:1.0:1788463323.565504:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 216 00000100:00100000:1.0:1788463323.565517:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:11617:x1875339395558784:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788463323.565813:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee36837 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.565836:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee36837 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.565851:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee36837 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.565900:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee3683e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.565909:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee3683e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.565917:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee3683e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.565958:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.565967:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.565974:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463323.566020:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788463323.566026:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463323.566042:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566053:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee36837 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566060:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee36837 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566067:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee36837 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566085:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463323.566090:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee36837 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566098:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee36837 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566124:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:1.0:1788463323.566127:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463323.566132:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee36837 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566137:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee36837 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566153:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee3683e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566159:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee3683e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566164:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee3683e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566168:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf7a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463323.566171:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee3683e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566177:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee3683e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566195:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9ba5d9430000) 00010000:00010000:1.0:1788463323.566198:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463323.566201:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee3683e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566207:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee3683e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566224:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566232:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566238:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566243:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf7000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463323.566246:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566251:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566259:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463323.566261:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463323.566264:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.566284:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36845 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463323.566546:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:11617:x1875339395558784:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 Request processed in 1026us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.566557:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 216 00000100:00100000:3.0:1788463323.573868:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463323.576489:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395559040 00000100:00100000:2.0:1788463323.576517:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395559040 00000100:00100000:2.0:1788463323.576734:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 217 00000100:00100000:2.0:1788463323.576749:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+60:11617:x1875339395559040:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463323.576780:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463323.576809:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3684c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e102 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.576954:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.576973:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.576989:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463323.577028:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788463323.577217:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.577226:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.577234:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.577241:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463323.577246:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.577255:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36853 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.577270:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:2.0:1788463323.577274:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788463323.577280:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36853 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.577287:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.577352:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3684c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e102 expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.577364:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:2.0:1788463323.577366:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463323.577378:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38a00/0xc3fe72277ee3684c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e102 expref: 62 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.577390:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38a00, rc 0) 00000100:00100000:2.0:1788463323.577494:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:11617:x1875339395559040:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 749us (3644us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788463323.577502:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 217 00000100:00100000:0.0:1788463323.584025:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.584188:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395559168 00000100:00100000:1.0:1788463323.584200:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395559168 00000100:00100000:1.0:1788463323.584272:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 218 00000100:00100000:1.0:1788463323.584285:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:11617:x1875339395559168:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788463323.584365:0:5818:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788463323.584525:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:11617:x1875339395559168:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 241us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.584534:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 218 00000100:00100000:0.0:1788463323.587836:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.587940:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395559424 00000100:00100000:1.0:1788463323.587951:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395559424 00000100:00100000:1.0:1788463323.588023:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 219 00000100:00100000:1.0:1788463323.588035:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:11617:x1875339395559424:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463323.588061:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463323.588064:0:8864:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788463323.588095:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee367f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0e6 expref: 61 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.588135:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463323.588141:0:8864:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463323.588156:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36861 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e109 expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463323.588640:0:8864:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788463323.588965:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.588983:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.588999:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.589070:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7000/0xc3fe72277ee36861 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e109 expref: 63 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.589090:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e109 expref: 62 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.589098:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d9430000) 00010000:00010000:1.0:1788463323.589101:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463323.589103:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf7a00, rc 0) 00000100:00100000:1.0:1788463323.589201:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+62:11617:x1875339395559424:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 1167us (1373us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788463323.589211:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 219 00000100:00100000:3.0:1788463323.594484:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.595045:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395559680 00000100:00100000:0.0:1788463323.595061:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395559680 00000100:00100000:0.0:1788463323.595182:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 220 00000100:00100000:0.0:1788463323.595194:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+62:11617:x1875339395559680:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788463323.595263:0:8863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463323.595293:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7a00/0xc3fe72277ee36868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e109 expref: 62 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595315:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d9430000) 00010000:00010000:0.0:1788463323.595326:0:8863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463323.595357:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36876 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595372:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36876 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595403:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36876 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595421:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3687d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x792116e7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595427:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3687d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x792116e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595434:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3687d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x792116e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595527:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36876 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595534:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36876 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595541:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36876 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595547:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463323.595551:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36876 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595560:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36876 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595569:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:0.0:1788463323.595572:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463323.595832:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36876 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595848:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36876 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595861:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3687d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x792116e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595867:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3687d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x792116e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595872:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3687d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x792116e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595876:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463323.595880:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3687d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x792116e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595885:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3687d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x792116e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595893:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x792116e7 (ffff9ba5c519a600) 00010000:00010000:0.0:1788463323.595895:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463323.595898:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3687d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x792116e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.595902:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee3687d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x792116e7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463323.595992:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:11617:x1875339395559680:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 797us (1528us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788463323.596001:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 220 00000100:00100000:0.0:1788463323.598193:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463323.598275:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395559808 00000100:00100000:2.0:1788463323.598285:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395559808 00000100:00100000:2.0:1788463323.598336:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 221 00000100:00100000:2.0:1788463323.598345:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+61:11617:x1875339395559808:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463323.598367:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463323.598391:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36884 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e110 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.598428:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.598441:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.598452:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.598589:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38c00/0xc3fe72277ee36884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e110 expref: 63 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.598608:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e110 expref: 62 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.598628:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463323.598631:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788463323.598635:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38000, rc 0) 00000100:00100000:2.0:1788463323.598729:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+62:11617:x1875339395559808:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 385us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.598736:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 221 00000100:00100000:2.0:1788463323.602182:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463323.602264:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395560064 00000100:00100000:3.0:1788463323.602275:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395560064 00000100:00100000:3.0:1788463323.602328:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 222 00000100:00100000:3.0:1788463323.602338:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+62:11617:x1875339395560064:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463323.602432:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.602450:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.602470:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463323.602772:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788463323.602796:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355213110967ns, next at 356213108945ns, rc = 0 00000004:00010000:3.0:1788463323.602889:0:5817:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fd94c77 reply state 00000000fe3dd5d7 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463323.602898:0:5817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463323.602992:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+64:11617:x1875339395560064:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 655us (820us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788463323.602999:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 222 00010000:00010000:1.0:1788463323.604830:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.604848:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.604872:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.604879:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463323.604884:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.604893:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.604916:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:1.0:1788463323.604920:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788463323.604926:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.604933:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36892 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.617360:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.618172:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395560192 00000100:00100000:0.0:1788463323.618186:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395560192 00000100:00100000:0.0:1788463323.618258:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 223 00000100:00100000:0.0:1788463323.618268:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+63:11617:x1875339395560192:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463323.618294:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463323.618314:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e117 expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.618392:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e117 expref: 64 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.618410:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e117 expref: 64 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.618432:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:0.0:1788463323.618435:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463323.618439:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f800, rc 0) 00000100:00100000:0.0:1788463323.618528:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+64:11617:x1875339395560192:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 260us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463323.618536:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 223 00000100:00100000:3.0:1788463323.623357:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.623662:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395560320 00000100:00100000:1.0:1788463323.623673:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395560320 00000100:00080000:0.0:1788463323.623869:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788463323.625270:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:1.0:1788463323.625298:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2356:x1875339395560320:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788463323.625824:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:2356:x1875339395560320:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 539us (2476us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788463323.625833:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:1.0:1788463323.629788:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.629993:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395560576 00000100:00100000:0.0:1788463323.630007:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395560576 00000100:00100000:0.0:1788463323.630134:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:0.0:1788463323.630146:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+64:11617:x1875339395560576:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788463323.630399:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+65:11617:x1875339395560576:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 254us (627us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788463323.630421:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 60 00000100:00100000:0.0:1788463323.634027:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.634136:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395560832 00000100:00100000:1.0:1788463323.634148:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395560832 00000100:00100000:1.0:1788463323.634225:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 224 00000100:00100000:1.0:1788463323.634236:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fec5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+65:11617:x1875339395560832:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788463323.634448:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fec5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+65:11617:x1875339395560832:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 213us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.634457:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 224 00000100:00100000:2.0:1788463323.639255:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.639390:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395560960 00000100:00100000:1.0:1788463323.639403:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395560960 00000100:00100000:1.0:1788463323.639759:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 225 00000100:00100000:1.0:1788463323.639771:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+65:11617:x1875339395560960:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463323.639794:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463323.639820:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e11e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.639916:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7800/0xc3fe72277ee368a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.639934:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7800/0xc3fe72277ee368a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.639948:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7800/0xc3fe72277ee368a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463323.639992:0:5818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463323.640017:0:5818:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7800/0xc3fe72277ee368a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.640055:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e11e expref: 67 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.640100:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7800/0xc3fe72277ee368a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e11e expref: 66 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.640121:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:1.0:1788463323.640125:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788463323.640129:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf7800, rc 0) 00000100:00100000:1.0:1788463323.640217:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+66:11617:x1875339395560960:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 449us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.640225:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 225 00000100:00100000:0.0:1788463323.646137:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.646226:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395561088 00000100:00100000:1.0:1788463323.646240:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395561088 00000100:00100000:1.0:1788463323.646304:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 64 00000100:00100000:1.0:1788463323.646314:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+10:2355:x1875339395561088:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463323.646331:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463323.646353:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000552d9b59/0xc3fe72277ee368ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e125 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463323.646381:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99c8dc, blocks: 0x1 00010000:00010000:1.0:1788463323.646401:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1788463323.646405:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463323.646414:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000552d9b59/0xc3fe72277ee368ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e125 expref: 11 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.646435:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000552d9b59/0xc3fe72277ee368ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e125 expref: 11 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.646470:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf7200, rc 0) 00000100:00100000:1.0:1788463323.646548:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+11:2355:x1875339395561088:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 235us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.646556:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 64 00000100:00100000:2.0:1788463323.651129:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.651248:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395561344 00000100:00100000:1.0:1788463323.651264:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395561344 00000100:00100000:1.0:1788463323.651348:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 226 00000100:00100000:1.0:1788463323.651360:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+66:11617:x1875339395561344:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788463323.651512:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+66:11617:x1875339395561344:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 155us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.651520:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 226 00000100:00100000:2.0:1788463323.655157:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463323.655253:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395561472 00000100:00100000:3.0:1788463323.655266:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395561472 00000100:00100000:3.0:1788463323.655327:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 65 00000100:00100000:3.0:1788463323.655338:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+11:11617:x1875339395561472:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463323.655358:0:6665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463323.655380:0:6665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e12c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.655418:0:6665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000552d9b59/0xc3fe72277ee368ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e125 expref: 12 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.655428:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463323.655433:0:6665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463323.655439:0:6665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 12 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.655480:0:6665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000552d9b59/0xc3fe72277ee368ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e125 expref: 12 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.655513:0:6665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000552d9b59/0xc3fe72277ee368ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e125 expref: 12 pid: 6667 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463323.655528:0:6665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6665:1875339408130432:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463323.655679:0:6665:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528840 going to sleep for 11 seconds 00000100:00100000:0.0:1788463323.672139:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463323.672493:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395561600 00000100:00100000:2.0:1788463323.672504:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395561600 00010000:00010000:2.0:1788463323.672546:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000552d9b59/0xc3fe72277ee368ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e125 expref: 13 pid: 6667 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.672594:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 81 00000100:00100000:2.0:1788463323.672604:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2355:x1875339395561600:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463323.672620:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463323.672644:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000552d9b59/0xc3fe72277ee368ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e125 expref: 13 pid: 6667 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.672659:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000552d9b59/0xc3fe72277ee368ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e125 expref: 13 pid: 6667 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.672742:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463323.672747:0:5803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463323.672755:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 13 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.672767:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 13 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.672819:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 13 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.672836:0:5803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5f4be9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5803:1875339408130560:192.168.204.11@tcp:105: 00000100:00100000:2.0:1788463323.672940:0:5803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9249000 going to sleep for 11 seconds 00010000:00010000:3.0:1788463323.674269:0:6665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000552d9b59/0xc3fe72277ee368ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e125 expref: 13 pid: 6667 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463323.674294:0:6665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6665:1875339408130432:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463323.674329:0:6665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 12 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.674341:0:6665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1600, rc 0) 00000100:00100000:3.0:1788463323.674414:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:11617:x1875339395561472:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 19078us (19268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463323.674423:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 65 00000100:00100000:2.0:1788463323.676433:0:5803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5f4be9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5803:1875339408130560:192.168.204.11@tcp:105: 00000100:00100000:0.0:1788463323.677300:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.677404:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395561728 00000100:00100000:1.0:1788463323.677412:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395561728 00002000:00100000:1.0:1788463323.677478:0:6671:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ba5f7959880 x1875339395561728/t0(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:459/0 lens 504/0 e 0 to 0 dl 1788463334 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463323.677490:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5f7959880 with x1875339395561728 ext(0->12) 00002000:00010000:1.0:1788463323.677496:0:6671:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5f7959880 00000100:00100000:1.0:1788463323.677526:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1788463323.677535:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:2355:x1875339395561728:12345-192.168.204.11@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788463323.678070:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:2355:x1875339395561728:12345-192.168.204.11@tcp:4:lhsmtool_posix.0 Request processed in 533us (773us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788463323.678078:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00002000:00100000:1.0:1788463323.678086:0:6671:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ba5f7959880 x1875339395561728/t4294967320(0) o4->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:459/0 lens 504/448 e 0 to 0 dl 1788463334 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463323.678099:0:6671:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5f7959880 with x1875339395561728 ext(0->12) 00002000:00010000:1.0:1788463323.678103:0:6671:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5f7959880 00010000:00010000:2.0:1788463323.679662:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463323.679851:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2355:x1875339395561600:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 7241us (7717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.679863:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 81 00000100:00100000:2.0:1788463323.682125:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.682248:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395561856 00000100:00100000:1.0:1788463323.682263:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395561856 00000100:00100000:1.0:1788463323.682348:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 227 00000100:00100000:1.0:1788463323.682361:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+66:11617:x1875339395561856:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788463323.730366:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1788463323.730395:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ba4c1086480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788463323.730401:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c3e79000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5c57f4b40 00000020:00080000:0.0:1788463323.730405:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c3e79b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5ec748000 00000020:00080000:0.0:1788463323.730445:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ba5e0481cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788463323.730449:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c3e79900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5e0481180 00000020:00080000:0.0:1788463323.730452:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c3e79300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ba4c4a95800 00000020:00080000:2.0:1788463323.730551:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788463323.730831:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:0.0:1788463323.731000:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788463323.731037:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788463323.731054:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:3.0:1788463323.731327:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:11617:x1875339395561856:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 Request processed in 48961us (49219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463323.731339:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 227 00000100:00100000:3.0:1788463323.732955:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408130816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788463323.733030:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463323.733092:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788463323.733099:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fed66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408130688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788463323.734801:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463323.734864:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408130944:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788463323.734886:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463323.734939:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408130816 00000100:00100000:3.0:1788463323.734951:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408130816 00000100:00100000:3.0:1788463323.735024:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408130688 00000100:00100000:3.0:1788463323.735027:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408130688 00000100:00100000:3.0:1788463323.735039:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408130944 00000100:00100000:3.0:1788463323.735042:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408130944 00000100:00100000:3.0:1788463323.735058:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788463323.735067:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3277:x1875339408130816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788463323.735320:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463323.735871:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395561984 00000100:00100000:2.0:1788463323.735877:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395561984 00000100:00100000:2.0:1788463323.735911:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788463323.735920:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3277:x1875339408130688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788463323.735960:0:8660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788463323.735989:0:8660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.736013:0:8660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007da3555f/0xc3fe72277ee3667e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e08b expref: 13 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.736023:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788463323.736028:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463323.736035:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.736075:0:8660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007da3555f/0xc3fe72277ee3667e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e08b expref: 13 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.736092:0:8660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007da3555f/0xc3fe72277ee3667e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e08b expref: 13 pid: 6665 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.736123:0:8660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8660:1875339408131072:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463323.736229:0:8660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9249480 going to sleep for 11 seconds 00000100:00080000:2.0:1788463323.736959:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788463323.737258:0:6668:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788463323.737263:0:6668:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788463324 00002000:00010000:3.0:1788463323.737266:0:6668:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788463323.737268:0:6668:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788463324 -> 1788463324 00002000:00010000:3.0:1788463323.737271:0:6668:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788463323.737335:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3277:x1875339408130816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2266us (4304us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788463323.737344:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788463323.737372:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788463323.737382:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875339408130944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788463323.737401:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788463323.737422:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a99c8da, atime: 0x6a99c8db, ctime: 0x6a99c8da, blocks: 0x1 00010000:00010000:3.0:1788463323.737427:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee368c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.737442:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788463323.737456:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463323.737473:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee368c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.737490:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee368c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.737501:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee368c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.737509:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee368c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.737529:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788463323.738159:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3278:x1875339408130944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 776us (3268us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788463323.738169:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788463323.738193:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 69 00000100:00100000:3.0:1788463323.738204:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2354:x1875339395561984:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788463323.738267:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463323.738276:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee368c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.738287:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463323.738293:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee368c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.738314:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee368c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.738334:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee368c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.738341:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000460ac03d/0xc3fe72277ee368c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.738363:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463323.738365:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463323.738367:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788463323.738417:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5fee4c380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788463323.738423:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408130944:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788463323.738937:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5fee22300/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788463323.738945:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408130816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788463323.740500:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463323.740530:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395562112 00000100:00100000:2.0:1788463323.740539:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395562112 00000100:00100000:0.0:1788463323.740893:0:8660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8660:1875339408131072:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463323.740924:0:8660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.741023:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007da3555f/0xc3fe72277ee3667e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e08b expref: 14 pid: 6665 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.741076:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 82 00000100:00100000:2.0:1788463323.741090:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+14:2354:x1875339395562112:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463323.741217:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463323.741225:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007da3555f/0xc3fe72277ee3667e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e08b expref: 14 pid: 6665 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.741239:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007da3555f/0xc3fe72277ee3667e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e08b expref: 14 pid: 6665 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.741265:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007da3555f/0xc3fe72277ee3667e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e08b expref: 14 pid: 6665 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.741283:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463323.741288:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463323.741294:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.741304:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.741373:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463323.741432:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+13:2354:x1875339395562112:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 345us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.741451:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 82 00010000:00010000:0.0:1788463323.741930:0:8660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.741942:0:8660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.741961:0:8660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.741969:0:8660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.742822:0:8660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463323.743787:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463323.743797:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.743810:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39600 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463323.743815:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.743827:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.743851:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.743860:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b446709/0xc3fe72277ee368bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.743883:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463323.743886:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463323.743896:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463323.744439:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3277:x1875339408130688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8516us (9634us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788463323.744452:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1788463323.744773:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5fed66680/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788463323.744781:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fed66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408130688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788463323.780498:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+12:2354:x1875339395561984:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 Request processed in 42283us (45167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.780512:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 69 00000001:00080000:2.0:1788463323.781860:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1788463323.781890:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:2.0:1788463323.781900:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788463323.783057:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.783242:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395562368 00000100:00100000:1.0:1788463323.783254:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395562368 00000100:00100000:1.0:1788463323.783384:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 228 00000100:00100000:1.0:1788463323.783399:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:11617:x1875339395562368:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788463323.783553:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463323.783662:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7800/0xc3fe72277ee368a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e11e expref: 20 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.783840:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:1.0:1788463323.783848:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463323.783890:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.783906:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.783917:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463323.784329:0:5818:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b78da1f4 reply state 00000000fa3caef1 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463323.784341:0:5818:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463323.784545:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:11617:x1875339395562368:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 1148us (1497us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788463323.784553:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 228 00000100:00100000:3.0:1788463323.787068:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00010000:00010000:1.0:1788463323.787225:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.787239:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.787247:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.787254:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6600 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463323.787259:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.787267:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.787288:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:1.0:1788463323.787292:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463323.787298:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.787305:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6600/0xc3fe72277ee368ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.787852:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395562496 00000100:00100000:2.0:1788463323.787865:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395562496 00000100:00100000:2.0:1788463323.787970:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 70 00000100:00100000:2.0:1788463323.787984:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395562496:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788463323.788241:0:6665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788463323.788245:0:6665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788463324 -> 1788463323 00002000:00010000:2.0:1788463323.788247:0:6665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788463323 00002000:00010000:2.0:1788463323.788249:0:6665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788463324 -> 1788463323 00002000:00010000:2.0:1788463323.788251:0:6665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788463323.789068:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395562496:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 1081us (2004us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788463323.789079:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 70 00000100:00100000:3.0:1788463323.791475:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463323.791675:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395562752 00000100:00100000:2.0:1788463323.791711:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395562752 00000100:00100000:2.0:1788463323.791783:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 229 00000100:00100000:2.0:1788463323.791793:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:11617:x1875339395562752:12345-192.168.204.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788463323.791878:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.791901:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e110 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.791943:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.791994:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e110 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.792009:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e110 expref: 20 pid: 5816 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.792026:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1875339408131200:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463323.792134:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9249240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463323.799361:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.799448:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395562880 00000100:00100000:1.0:1788463323.799469:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395562880 00010000:00010000:1.0:1788463323.799514:0:8442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e110 expref: 21 pid: 5816 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463323.799727:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 83 00000100:00100000:1.0:1788463323.799740:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:2354:x1875339395562880:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463323.799758:0:8442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463323.799765:0:8442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e110 expref: 21 pid: 5816 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.799780:0:8442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e110 expref: 21 pid: 5816 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.799805:0:8442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:1.0:1788463323.799811:0:8442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.799822:0:8442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.799830:0:8442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.799851:0:8442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463323.799912:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:2354:x1875339395562880:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 175us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463323.799919:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 83 00010000:00010000:2.0:1788463323.800365:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee3688b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e110 expref: 20 pid: 5816 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.800387:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5817:1875339408131200:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463323.800412:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.800422:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.800427:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.800473:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.800481:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.800498:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.800505:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463323.800509:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.800518:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.800529:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:2.0:1788463323.800532:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788463323.800536:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.800542:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39400/0xc3fe72277ee368d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.800613:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11617:x1875339395562752:12345-192.168.204.11@tcp:55:lhsmtool_posix.0 Request processed in 8820us (9166us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788463323.800622:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 229 00000100:00100000:0.0:1788463323.804873:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463323.804987:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395563008 00000100:00100000:2.0:1788463323.805001:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395563008 00000100:00100000:2.0:1788463323.805073:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 71 00000100:00100000:2.0:1788463323.805087:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2357:x1875339395563008:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788463323.805167:0:8660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.805193:0:8660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 8 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.805211:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788463323.805217:0:8660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463323.805222:0:8660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.805263:0:8660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 8 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.805279:0:8660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 8 pid: 6665 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.805298:0:8660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8660:1875339408131328:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463323.805498:0:8660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9249240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463323.817673:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463323.818217:0:8660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee4dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8660:1875339408131328:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463323.818245:0:8660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463323.818825:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395563136 00000100:00100000:1.0:1788463323.818835:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395563136 00010000:00010000:2.0:1788463323.819004:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 9 pid: 6665 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.819068:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 84 00000100:00100000:2.0:1788463323.819081:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8590000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+9:2355:x1875339395563136:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463323.819120:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463323.819162:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 9 pid: 6665 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.819179:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 9 pid: 6665 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.819232:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c9bf20e/0xc3fe72277ee368b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e12c expref: 9 pid: 6665 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.819251:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463323.819255:0:5804:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788463323.819262:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.819271:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.819312:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463323.819403:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8590000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395563136:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 324us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.819412:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 84 00010000:00010000:3.0:1788463323.820292:0:8660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.820310:0:8660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.820363:0:8660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.820371:0:8660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.820380:0:8660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.820386:0:8660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463323.820391:0:8660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.820401:0:8660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.820417:0:8660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.820424:0:8660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084a2e3c1/0xc3fe72277ee368d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463323.820804:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2357:x1875339395563008:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 Request processed in 15717us (15941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463323.820815:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 71 00000100:00100000:0.0:1788463323.824798:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463323.824895:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395563392 00000100:00100000:3.0:1788463323.824908:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395563392 00000100:00100000:3.0:1788463323.825066:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 230 00000100:00100000:3.0:1788463323.825080:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11617:x1875339395563392:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788463323.825290:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee368df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.825317:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee368df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.825331:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee368df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.825788:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.825802:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36899 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e117 expref: 20 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.825810:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.825859:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e117 expref: 20 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.825878:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36899 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e117 expref: 20 pid: 8863 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463323.825894:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408131456:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463323.826258:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c85286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463323.830655:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408131456:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463323.830655:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.831429:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395563520 00000100:00100000:0.0:1788463323.831440:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395563520 00010000:00010000:0.0:1788463323.831560:0:5803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36899 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e117 expref: 21 pid: 8863 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.831746:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463323.831824:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 85 00000100:00100000:0.0:1788463323.831836:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:2354:x1875339395563520:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463323.831856:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463323.831865:0:5803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36899 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e117 expref: 21 pid: 8863 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.831902:0:5803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e117 expref: 21 pid: 8863 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.831951:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36899 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e117 expref: 21 pid: 8863 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.831971:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:0.0:1788463323.831977:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.831987:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.831995:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.832028:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463323.832117:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:2354:x1875339395563520:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 268us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463323.832127:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 85 00010000:00010000:3.0:1788463323.832245:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.832253:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463323.832536:0:8864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788463323.832745:0:8864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788463323.832798:0:8864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788463323.832895:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8864:1875339408131584:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788463323.832953:0:8864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463323.832990:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c85289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463323.833042:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408131584 00000100:00100000:2.0:1788463323.833052:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408131584 00000100:00100000:2.0:1788463323.833124:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463323.833132:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8864:x1875339408131584:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788463323.833202:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8864:x1875339408131584:12345-0@lo:1000:mdt00_004.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.833210:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788463323.833286:0:8864:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1788463323.833292:0:8864:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1788463323.833314:0:8864:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5fee22300, transno 4294967321 00000100:00100000:3.0:1788463323.833339:0:8864:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ba5fed66680 x1875339408130688/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788463339 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463323.833349:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8864:1875339408131584:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788463323.834383:0:8864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788463323.834774:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dda300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8864:1875339408131712:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788463323.834847:0:8864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463323.834894:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463323.835450:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408131712 00000100:00100000:3.0:1788463323.835460:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408131712 00000100:00100000:3.0:1788463323.835507:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463323.835518:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8864:x1875339408131712:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788463323.836244:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8864:x1875339408131712:12345-0@lo:1000:mdt00_004.0 Request processed in 723us (1392us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788463323.836254:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788463323.836355:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dda300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8864:1875339408131712:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788463323.836438:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836451:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836461:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836469:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463323.836477:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836486:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836515:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5d0c1e100) 00010000:00010000:3.0:1788463323.836519:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463323.836525:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836532:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1400/0xc3fe72277ee368e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836570:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836848:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836854:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836872:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463323.836875:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836882:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836891:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:3.0:1788463323.836894:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463323.836903:0:8864:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee36830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0fb expref: 23 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836916:0:8864:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee36830 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0fb expref: 23 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836926:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee36830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0fb expref: 23 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.836975:0:8864:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee36830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0fb expref: 23 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463323.836992:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408131840:192.168.204.11@tcp:105: 00000100:00100000:3.0:1788463323.837098:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0481840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463323.840925:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.841014:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395563648 00000100:00100000:0.0:1788463323.841029:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395563648 00000100:00100000:0.0:1788463323.841130:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:2.0:1788463323.841136:0:5819:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1788463323.841142:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11616:x1875339395563648:12345-192.168.204.11@tcp:49:lfs.0 00000100:00100000:2.0:1788463323.841148:0:5819:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1788463323.841328:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11616:x1875339395563648:12345-192.168.204.11@tcp:49:lfs.0 Request processed in 188us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463323.841336:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 61 00000100:00100000:3.0:1788463323.842671:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408131840:192.168.204.11@tcp:105: 00010000:00010000:3.0:1788463323.842729:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.842761:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee36829 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.842814:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee368ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.842835:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee368ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.842851:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee368ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.842865:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee368ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.842873:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee368ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.842880:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee368ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.842887:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463323.842892:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee368ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.842901:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee368ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.844383:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:3.0:1788463323.844394:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463323.844403:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee368ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.844421:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee368ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.844440:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee368df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.844447:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee368df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.844582:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee368df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.844589:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463323.844594:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee368df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.844603:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee368df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.844620:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:3.0:1788463323.844623:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788463323.844627:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee368df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.844633:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1000/0xc3fe72277ee368df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463323.846204:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.846299:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395563904 00000100:00100000:0.0:1788463323.846311:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395563904 00000100:00100000:0.0:1788463323.846409:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 231 00000100:00100000:0.0:1788463323.846420:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11616:x1875339395563904:12345-192.168.204.11@tcp:58:lfs.0 00000040:00080000:0.0:1788463323.846986:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788463323.847094:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+24:11616:x1875339395563904:12345-192.168.204.11@tcp:58:lfs.0 Request processed in 674us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463323.847115:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 231 00000100:00100000:2.0:1788463323.851579:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:11617:x1875339395563392:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 26483us (26773us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788463323.851597:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 230 00000020:00080000:2.0:1788463323.851604:0:8864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788463323.851918:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463323.851926:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463323.851987:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788463323.851995:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788463323.852264:0:11682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408131968:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788463323.852370:0:11682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9249a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463323.862429:0:11682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11682:1875339408131968:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788463323.866029:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.866098:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463323.866463:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395564032 00000100:00100000:2.0:1788463323.866474:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395564032 00000100:00100000:2.0:1788463323.866539:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 232 00000100:00100000:2.0:1788463323.866550:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:11618:x1875339395564032:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788463323.866600:0:5817:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788463323.866759:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:11618:x1875339395564032:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 209us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.866769:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 232 00000100:00100000:0.0:1788463323.866806:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395564288 00000100:00100000:0.0:1788463323.866819:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395564288 00000100:00100000:0.0:1788463323.867438:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 62 00000100:00100000:0.0:1788463323.867451:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05a5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:11617:x1875339395564288:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788463323.869053:0:5820:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788463323.869184:0:5820:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788463323.869249:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.869273:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.869288:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.869367:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.869374:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.869380:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.869422:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788463323.869841:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05a5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+25:11617:x1875339395564288:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 2090us (3438us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788463323.869854:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 62 00000020:00080000:0.0:1788463323.869860:0:5820:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788463323.870143:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463323.870153:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.870160:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463323.870165:0:7624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.870173:0:7624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.870188:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ba5c519a400) 00010000:00010000:1.0:1788463323.870191:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788463323.870195:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.870202:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee368f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5820 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463323.870231:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463323.870233:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463323.870235:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463323.878842:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.879142:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395564544 00000100:00100000:0.0:1788463323.879155:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395564544 00000100:00100000:0.0:1788463323.879227:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 233 00000100:00100000:0.0:1788463323.879240:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+25:11618:x1875339395564544:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463323.879268:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463323.879562:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee368fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e133 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.879897:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36902 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.880141:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.880156:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463323.880168:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788463323.881061:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee368fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e133 expref: 28 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.881094:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e133 expref: 27 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.881138:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:2.0:1788463323.881141:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788463323.881145:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f800, rc 0) 00000100:00100000:2.0:1788463323.881250:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:11618:x1875339395564544:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 2007us (2415us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788463323.881261:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 233 00000100:00100000:0.0:1788463323.891770:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463323.891934:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395564672 00000100:00100000:2.0:1788463323.891947:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395564672 00000100:00100000:2.0:1788463323.892039:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 234 00000100:00100000:2.0:1788463323.892051:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+27:11620:x1875339395564672:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463323.892081:0:8864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463323.892118:0:8864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36910 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e13a expref: -99 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.892247:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36917 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.892268:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36917 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.892284:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36917 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.893254:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee3691e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.893273:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee3691e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.893782:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee3691e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.894124:0:8864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.894145:0:8864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0f4 expref: 28 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.894156:0:8864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.894203:0:8864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0f4 expref: 28 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.894223:0:8864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0f4 expref: 28 pid: 5818 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.894238:0:8864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408132096:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463323.894381:0:8864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9249f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463323.899962:0:8864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8864:1875339408132096:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463323.900014:0:8864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463323.900529:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463323.900623:0:12521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395564928 00000100:00100000:1.0:1788463323.900631:0:12521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395564928 00000100:00100000:1.0:1788463323.900888:0:12521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:1.0:1788463323.900900:0:12521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:5593:x1875339395564928:12345-192.168.204.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788463323.901212:0:12521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:5593:x1875339395564928:12345-192.168.204.11@tcp:35:ldlm_bl.0 Request processed in 315us (685us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788463323.901243:0:12521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 63 00000100:00100000:3.0:1788463323.913721:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463323.913766:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.913944:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395565312 00000100:00100000:0.0:1788463323.913958:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395565312 00000100:00100000:0.0:1788463323.914041:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 235 00000100:00100000:2.0:1788463323.914128:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395565056 00000100:00100000:2.0:1788463323.914133:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395565056 00010000:00010000:2.0:1788463323.914168:0:5804:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0f4 expref: 31 pid: 5818 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.914229:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00100000:2.0:1788463323.914239:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:2354:x1875339395565056:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463323.914258:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463323.914267:0:5804:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0f4 expref: 31 pid: 5818 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.914281:0:5804:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0f4 expref: 31 pid: 5818 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.914318:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee3681b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0f4 expref: 31 pid: 5818 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.914337:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:2.0:1788463323.914342:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.914352:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.914359:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463323.914391:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463323.914486:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:11618:x1875339395565312:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788463323.914557:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3692c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.914569:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3692c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.914578:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3692c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.914848:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3692c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.914857:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3692c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.914864:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3692c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.914870:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463323.914875:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3692c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.914884:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3692c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.914894:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:0.0:1788463323.914897:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788463323.914901:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3692c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463323.914907:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e200/0xc3fe72277ee3692c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463323.915065:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+31:11618:x1875339395565312:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 994us (1296us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788463323.916205:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 235 00010000:00010000:3.0:1788463323.916262:0:8864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.916275:0:8864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463323.916324:0:8864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788463323.916330:0:8864:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463323.916356:0:8864:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.916371:0:8864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.916381:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36917 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.916388:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36917 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.916395:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36917 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.916400:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463323.916405:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36917 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.916412:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36917 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.916425:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:3.0:1788463323.916439:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463323.916443:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36917 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.916450:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36917 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463323.916511:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:2354:x1875339395565056:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 1164us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463323.916521:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 86 00000040:00080000:2.0:1788463323.916743:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463323.916753:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463323.917261:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788463323.917271:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788463323.917818:0:8864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee3691e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.917830:0:8864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee3691e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.917837:0:8864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee3691e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.917842:0:8864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463323.917847:0:8864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee3691e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.917853:0:8864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee3691e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.917867:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ba5e0495900) 00010000:00010000:3.0:1788463323.917870:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463323.917875:0:8864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee3691e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.917881:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39e00/0xc3fe72277ee3691e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.917931:0:8864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36910 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e13a expref: 30 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.918082:0:8864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e13a expref: 29 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463323.918090:0:8864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:3.0:1788463323.918093:0:8864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463323.918095:0:8864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39000, rc 0) 00000100:00100000:3.0:1788463323.918263:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:11620:x1875339395564672:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 26213us (26504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463323.918272:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 234 00000100:00100000:3.0:1788463323.921448:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463323.921533:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395565568 00000100:00100000:0.0:1788463323.921543:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395565568 00000100:00100000:0.0:1788463323.921606:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 64 00000100:00100000:0.0:1788463323.921617:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+29:11618:x1875339395565568:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788463323.921921:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:11618:x1875339395565568:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 305us (481us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788463323.921929:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 64 00010000:00010000:2.0:1788463324.005221:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463324.711030:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408132224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463324.711142:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463324.718003:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408132224 00000100:00100000:3.0:1788463324.718021:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408132224 00000100:00100000:3.0:1788463324.718106:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788463324.718120:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408132224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463324.718156:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788463324.718247:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408132224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (7105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463324.718255:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788463324.718317:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408132224:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788463325.028772:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463325.039043:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788463325.039062:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463325.039133:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788463325.039141:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788463325.324118:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463325.337698:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395565824 00000100:00100000:2.0:1788463325.337719:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395565824 00000100:00100000:0.0:1788463325.338090:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 236 00000100:00100000:0.0:1788463325.338109:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+30:11643:x1875339395565824:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:0.0:1788463325.338159:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463325.338194:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36933 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e141 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.338328:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee3693a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.338347:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee3693a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.338364:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee3693a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463325.338379:0:5818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788463325.338558:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710fa00/0xc3fe72277ee36933 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e141 expref: 33 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.338579:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee3693a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e141 expref: 32 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.338588:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:0.0:1788463325.338592:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788463325.338596:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e600, rc 0) 00000100:00080000:2.0:1788463325.338829:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463325.339047:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11643:x1875339395565824:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 939us (14935us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788463325.339058:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 236 00000100:00100000:3.0:1788463325.346383:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463325.346822:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395565952 00000100:00100000:0.0:1788463325.346834:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395565952 00000100:00100000:0.0:1788463325.346908:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 237 00000100:00100000:0.0:1788463325.346919:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11643:x1875339395565952:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:0.0:1788463325.347012:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.347031:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.347043:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.347090:0:8863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.347098:0:8863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36948 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.347125:0:8863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.347132:0:8863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463325.347139:0:8863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.347150:0:8863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.347166:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:0.0:1788463325.347170:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788463325.347176:0:8863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36948 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463325.347183:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f400/0xc3fe72277ee36948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463325.347292:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:11643:x1875339395565952:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 373us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463325.347300:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 237 00000100:00100000:3.0:1788463325.491249:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463325.491363:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395566080 00000100:00100000:1.0:1788463325.491374:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395566080 00000100:00100000:1.0:1788463325.491478:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00100000:1.0:1788463325.491493:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2356:x1875339395566080:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:1.0:1788463325.491518:0:6667:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463325.491549:0:6667:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ade78eb1/0xc3fe72277ee3694f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e148 expref: -99 pid: 6667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788463325.491584:0:6667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a99c8db, atime: 0x6a99c8db, ctime: 0x6a99c8db, blocks: 0xb 00010000:00010000:1.0:1788463325.491621:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1788463325.491626:0:6667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463325.491638:0:6667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ade78eb1/0xc3fe72277ee3694f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e148 expref: 8 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463325.491661:0:6667:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ade78eb1/0xc3fe72277ee3694f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e148 expref: 8 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463325.491676:0:6667:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf6400, rc 0) 00000100:00100000:1.0:1788463325.491790:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2356:x1875339395566080:12345-192.168.204.11@tcp:101:cat.0 Request processed in 301us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463325.491797:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 72 00000100:00080000:2.0:1788463325.492293:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463325.499531:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463325.500286:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395566208 00000100:00100000:1.0:1788463325.500314:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395566208 00002000:00100000:1.0:1788463325.500371:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ba5e8591180 x1875339395566208/t0(0) o3->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:461/0 lens 488/0 e 0 to 0 dl 1788463336 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463325.500384:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5e8591180 with x1875339395566208 ext(0->4095) 00002000:00010000:1.0:1788463325.500390:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5e8591180 00000100:00100000:1.0:1788463325.500430:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1788463325.500440:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395566208:12345-192.168.204.11@tcp:3:cat.0 00000100:00100000:1.0:1788463325.500879:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8591180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2355:x1875339395566208:12345-192.168.204.11@tcp:3:cat.0 Request processed in 438us (1358us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788463325.500887:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00002000:00100000:1.0:1788463325.500894:0:6672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ba5e8591180 x1875339395566208/t0(0) o3->c87dc105-ebf6-45f0-8943-2a25b33dd5b8@192.168.204.11@tcp:461/0 lens 488/4536 e 0 to 0 dl 1788463336 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788463325.500904:0:6672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba5e8591180 with x1875339395566208 ext(0->4095) 00002000:00010000:1.0:1788463325.500907:0:6672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ba5e8591180 00000100:00100000:3.0:1788463325.734130:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875339408132736:0@lo:400:kworker.0 00000100:00100000:3.0:1788463325.734220:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463325.734284:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788463325.734290:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408132608:0@lo:400:kworker.0 00000100:00100000:3.0:1788463325.734332:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463325.734367:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408132736 00000100:00100000:3.0:1788463325.734375:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408132736 00000100:00100000:3.0:1788463325.734440:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788463325.734449:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875339408132736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463325.734504:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875339408132736:12345-0@lo:400:kworker.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463325.734511:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788463325.734554:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875339408132736:0@lo:400:kworker.0 00000100:00080000:3.0:1788463325.734581:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463325.734709:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408132352:0@lo:400:kworker.0 00000100:00100000:0.0:1788463325.734745:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463325.734785:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408132864:0@lo:400:kworker.0 00000100:00100000:0.0:1788463325.734809:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463325.734830:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788463325.734835:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408132480:0@lo:400:kworker.0 00000100:00100000:0.0:1788463325.734870:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463325.734889:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fee22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408132992:0@lo:400:kworker.0 00000100:00100000:0.0:1788463325.734910:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463325.734950:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408132864 00000100:00100000:0.0:1788463325.734954:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408132864 00000100:00100000:0.0:1788463325.734983:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408132480 00000100:00100000:0.0:1788463325.734986:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408132480 00000100:00100000:0.0:1788463325.735000:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788463325.735007:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408132864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463325.735043:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408132864:12345-0@lo:400:kworker.0 Request processed in 37us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463325.735050:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788463325.735065:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788463325.735083:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408132480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463325.735110:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408132480:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463325.735116:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788463325.735146:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408132480:0@lo:400:kworker.0 00000100:00100000:0.0:1788463325.735156:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408132864:0@lo:400:kworker.0 00000100:00100000:1.0:1788463325.735305:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408132608 00000100:00100000:1.0:1788463325.735310:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408132608 00000100:00100000:1.0:1788463325.735351:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408132992 00000100:00100000:1.0:1788463325.735354:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408132992 00000100:00100000:1.0:1788463325.735377:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788463325.735384:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408132608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463325.735425:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408132608:12345-0@lo:400:kworker.0 Request processed in 42us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463325.735432:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788463325.735444:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788463325.735450:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408132992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463325.735493:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8593480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3276:x1875339408132992:12345-0@lo:400:kworker.0 Request processed in 43us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463325.735499:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788463325.735528:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408132608:0@lo:400:kworker.0 00000100:00100000:1.0:1788463325.735557:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408132992:0@lo:400:kworker.0 00000100:00100000:3.0:1788463325.735731:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408132352 00000100:00100000:3.0:1788463325.735736:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408132352 00000100:00100000:3.0:1788463325.735770:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788463325.735778:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408132352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463325.735823:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408132352:12345-0@lo:400:kworker.0 Request processed in 46us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463325.735828:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:3.0:1788463325.735865:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463325.735869:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463325.735871:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463325.736028:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fee20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408132352:0@lo:400:kworker.0 00010000:00010000:1.0:1788463326.052814:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463326.245007:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408133120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463326.245096:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463326.245220:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408133120 00000100:00100000:3.0:1788463326.245228:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408133120 00000100:00100000:3.0:1788463326.245289:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788463326.245307:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875339408133120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463326.245353:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463326.245401:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875339408133120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463326.245409:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788463326.245456:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408133120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463326.932523:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463326.932863:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463326.933000:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463326.933033:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463326.933072:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463326.933162:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395566848 00000100:00100000:0.0:1788463326.933177:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395566848 00000100:00100000:0.0:1788463326.933277:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395566464 00000100:00100000:0.0:1788463326.933282:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395566464 00000100:00100000:0.0:1788463326.933308:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 172 00000100:00100000:0.0:1788463326.933319:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2357:x1875339395566848:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463326.933430:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8591880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:2357:x1875339395566848:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 112us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463326.933438:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 172 00000100:00100000:0.0:1788463326.933460:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 173 00000100:00100000:0.0:1788463326.933469:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:2357:x1875339395566464:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463326.933501:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+32:2357:x1875339395566464:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 34us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463326.933507:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 173 00000100:00100000:1.0:1788463326.937037:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395566592 00000100:00100000:1.0:1788463326.937069:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395566592 00000100:00100000:1.0:1788463326.937349:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395566720 00000100:00100000:1.0:1788463326.937355:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395566720 00000100:00100000:1.0:1788463326.937397:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 98 00000100:00100000:1.0:1788463326.937409:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2357:x1875339395566592:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463326.937494:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+8:2357:x1875339395566592:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 88us (4633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463326.937502:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 98 00000100:00100000:1.0:1788463326.937522:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 99 00000100:00100000:1.0:1788463326.937528:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2357:x1875339395566720:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463326.937552:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8591c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2357:x1875339395566720:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 24us (4480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463326.937557:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 99 00000100:00080000:1.0:1788463326.939528:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463326.939538:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463326.942408:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395566336 00000100:00100000:2.0:1788463326.942426:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395566336 00000100:00100000:2.0:1788463326.942498:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 304 00000100:00100000:2.0:1788463326.942511:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2357:x1875339395566336:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463326.942792:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2357:x1875339395566336:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 281us (10285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463326.942800:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 304 00010000:00010000:0.0:1788463327.094867:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788463327.348500:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788463327.348521:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788463327.348531:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:0.0:1788463328.101868:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788463328.901348:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1788463328.901383:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788463328.901393:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788463328.926138:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788463328.926200:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788463328.926215:0:5839:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ba5c85289c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788463328.926221:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c9078400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5c8528840 00000020:00080000:2.0:1788463328.926239:0:5839:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ba5c9078800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ba5ec1ee800 00000020:00080000:3.0:1788463328.926310:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788463328.926663:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788463329.124891:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463329.829476:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408133248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463329.829579:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463329.829681:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408133248 00000100:00100000:3.0:1788463329.829721:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408133248 00000100:00100000:3.0:1788463329.829799:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788463329.829812:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408133248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463329.829862:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463329.829915:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408133248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463329.829923:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788463329.829977:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788463329.829984:0:3279:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5fed66680, transno 4294967322 00000004:00080000:3.0:1788463329.830012:0:3279:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788463329.830049:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408133248:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788463329.832442:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788463330.154205:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463330.861347:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408133376:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.861428:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463330.861476:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408133888:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.861503:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463330.861529:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788463330.861535:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408133504:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.861556:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463330.861574:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408134016:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.861598:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463330.861624:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408133632:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.861644:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463330.861661:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463330.861666:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408133760:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.861712:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463330.861742:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408133376 00000100:00100000:1.0:1788463330.861751:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408133376 00000100:00100000:1.0:1788463330.863161:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788463330.863176:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408133376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.863253:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408133376:12345-0@lo:400:kworker.0 Request processed in 81us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463330.863261:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788463330.863307:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408133888 00000100:00100000:1.0:1788463330.863313:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408133888 00000100:00100000:1.0:1788463330.863350:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408133504 00000100:00100000:1.0:1788463330.863354:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408133504 00000100:00100000:1.0:1788463330.863371:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408133760 00000100:00100000:1.0:1788463330.863385:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408133760 00000100:00100000:1.0:1788463330.863404:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788463330.863410:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408133888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.863444:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408133888:12345-0@lo:400:kworker.0 Request processed in 35us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463330.863450:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788463330.863462:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788463330.863468:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408133504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.863494:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408133504:12345-0@lo:400:kworker.0 Request processed in 27us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463330.863500:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788463330.863510:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788463330.863516:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408133760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.863547:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408133760:12345-0@lo:400:kworker.0 Request processed in 31us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463330.863552:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788463330.863573:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408134016 00000100:00100000:1.0:1788463330.863576:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408134016 00000100:00100000:1.0:1788463330.863601:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408133632 00000100:00100000:1.0:1788463330.863604:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408133632 00000100:00100000:1.0:1788463330.863622:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788463330.863628:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408134016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.863658:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408134016:12345-0@lo:400:kworker.0 Request processed in 30us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463330.863664:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788463330.863675:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788463330.863699:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408133632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.863736:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408133632:12345-0@lo:400:kworker.0 Request processed in 56us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463330.863742:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788463330.869931:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408133504:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.869978:0:3276:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788463330.869986:0:3276:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788463330.870021:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5fee4c380, transno 4294967310 00000100:00100000:1.0:1788463330.870051:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408134016:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.870064:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408133376:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.870078:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408133888:0@lo:400:kworker.0 00000100:00080000:1.0:1788463330.870119:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788463330.870127:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463330.870161:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408133760:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.870174:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408133632:0@lo:400:kworker.0 00000100:00100000:1.0:1788463330.922632:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463330.922837:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395566976 00000100:00100000:3.0:1788463330.922850:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395566976 00000100:00100000:3.0:1788463330.922961:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 238 00000100:00100000:3.0:1788463330.922985:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11304:x1875339395566976:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788463330.923125:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11304:x1875339395566976:12345-192.168.204.11@tcp:60:lhsmtool_posix.0 Request processed in 143us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463330.923134:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 238 00000100:00080000:1.0:1788463330.923197:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463330.927100:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463330.927174:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395567232 00000100:00100000:0.0:1788463330.927188:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395567232 00000100:00100000:0.0:1788463330.927256:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 65 00000100:00100000:0.0:1788463330.927268:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:11304:x1875339395567232:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788463330.927609:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:11304:x1875339395567232:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 342us (520us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788463330.927617:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 65 00010000:00010000:0.0:1788463331.173052:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463331.216383:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463331.216588:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395567360 00000100:00100000:1.0:1788463331.216600:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395567360 00000100:00100000:1.0:1788463331.216758:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 239 00000100:00100000:1.0:1788463331.216772:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f4b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+5:12095:x1875339395567360:12345-192.168.204.11@tcp:101:lsof.0 00010000:00010000:1.0:1788463331.216802:0:8863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463331.216833:0:8863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6c00/0xc3fe72277ee36956 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e14f expref: -99 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463331.216974:0:8863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7e00/0xc3fe72277ee3695d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463331.216995:0:8863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7e00/0xc3fe72277ee3695d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463331.217009:0:8863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7e00/0xc3fe72277ee3695d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463331.217062:0:8863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788463331.217068:0:8863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463331.217096:0:8863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7e00/0xc3fe72277ee3695d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463331.217127:0:8863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6c00/0xc3fe72277ee36956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e14f expref: 7 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463331.217152:0:8863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7e00/0xc3fe72277ee3695d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e14f expref: 6 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463331.217164:0:8863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:1.0:1788463331.217167:0:8863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463331.217171:0:8863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf7e00, rc 0) 00000100:00100000:1.0:1788463331.217241:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f4b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:12095:x1875339395567360:12345-192.168.204.11@tcp:101:lsof.0 Request processed in 472us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463331.217248:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 239 00000100:00080000:2.0:1788463331.217836:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463331.364990:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408134144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463331.365090:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463331.365617:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408134144 00000100:00100000:3.0:1788463331.365628:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408134144 00000100:00100000:3.0:1788463331.365718:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788463331.365729:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408134144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463331.365771:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463331.365834:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408134144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463331.365841:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788463331.366035:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408134144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463332.043075:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463332.043118:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463332.043153:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463332.043182:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463332.043216:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463332.043256:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395567744 00000100:00100000:1.0:1788463332.043267:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395567744 00000100:00100000:2.0:1788463332.043474:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395567488 00000100:00100000:2.0:1788463332.043479:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395567488 00000100:00100000:2.0:1788463332.043515:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 306 00000100:00100000:2.0:1788463332.043525:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395567488:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463332.043601:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2354:x1875339395567488:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 77us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463332.043609:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 306 00000100:00080000:2.0:1788463332.043645:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463332.043817:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395568000 00000100:00100000:2.0:1788463332.043821:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395568000 00000100:00100000:2.0:1788463332.043845:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395567616 00000100:00100000:2.0:1788463332.043848:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395567616 00000100:00100000:2.0:1788463332.043867:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 177 00000100:00100000:2.0:1788463332.043874:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2354:x1875339395568000:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463332.043909:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2354:x1875339395568000:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 35us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463332.043916:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 177 00000100:00100000:2.0:1788463332.043927:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 178 00000100:00100000:2.0:1788463332.043934:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:2354:x1875339395567616:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463332.043979:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:2354:x1875339395567616:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 45us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463332.043986:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 178 00000100:00080000:2.0:1788463332.044027:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463332.044091:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395567872 00000100:00100000:2.0:1788463332.044096:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395567872 00000100:00100000:2.0:1788463332.044128:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 102 00000100:00100000:2.0:1788463332.044136:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395567744:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463332.044169:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2354:x1875339395567744:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 34us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463332.044176:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 102 00000100:00100000:2.0:1788463332.044190:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 103 00000100:00100000:2.0:1788463332.044197:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395567872:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463332.044220:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7e1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395567872:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 24us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463332.044225:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 103 00000100:00080000:2.0:1788463332.044255:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788463332.133021:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788463332.133035:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463332.133542:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788463332.133551:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788463332.196982:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463333.221036:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788463334.027480:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788463334.028399:0:5839:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788463334.028438:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788463334.028454:0:5850:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788463334.244883:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463334.949050:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463334.949078:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408134272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463334.949173:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463334.949546:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408134272 00000100:00100000:3.0:1788463334.949556:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408134272 00000100:00100000:3.0:1788463334.949638:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788463334.949649:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408134272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463334.949714:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463334.949778:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f795ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408134272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463334.949785:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788463334.950078:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408134272:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788463334.950173:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788463335.272928:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463335.721457:0:12762:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:22:14 (1788463334) 00000100:00100000:3.0:1788463335.981565:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408134400:0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.981660:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463335.981729:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408134912:0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.981756:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463335.981786:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788463335.981792:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408134528:0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.981814:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463335.981833:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408135040:0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.981857:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463335.981901:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408134656:0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.981924:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463335.981944:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463335.981949:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408134784:0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.981971:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463335.982015:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408134400 00000100:00100000:3.0:1788463335.982023:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408134400 00000100:00100000:3.0:1788463335.982082:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788463335.982093:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408134400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.982160:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408134400:12345-0@lo:400:kworker.0 Request processed in 69us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463335.982167:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788463335.982208:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408134912 00000100:00100000:3.0:1788463335.982213:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408134912 00000100:00100000:3.0:1788463335.982253:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408134528 00000100:00100000:3.0:1788463335.982256:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408134528 00000100:00100000:3.0:1788463335.982291:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408134784 00000100:00100000:3.0:1788463335.982294:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408134784 00000100:00100000:3.0:1788463335.982313:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788463335.982320:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408134912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.982355:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408134912:12345-0@lo:400:kworker.0 Request processed in 36us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463335.982361:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788463335.982374:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788463335.982379:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408134528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.982404:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408134528:12345-0@lo:400:kworker.0 Request processed in 25us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463335.982410:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788463335.982421:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788463335.982427:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408134784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.982458:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408134784:12345-0@lo:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463335.982464:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788463335.982482:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408135040 00000100:00100000:3.0:1788463335.982486:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408135040 00000100:00100000:3.0:1788463335.982510:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408134656 00000100:00100000:3.0:1788463335.982513:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408134656 00000100:00100000:3.0:1788463335.982528:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788463335.982533:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408135040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.982561:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408135040:12345-0@lo:400:kworker.0 Request processed in 29us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463335.982567:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788463335.982577:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788463335.982590:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408134656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.982619:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408134656:12345-0@lo:400:kworker.0 Request processed in 30us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463335.982624:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788463335.982669:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408134528:0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.982679:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408135040:0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.982711:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408134400:0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.982720:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408134912:0@lo:400:kworker.0 00000100:00080000:3.0:1788463335.982747:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788463335.982752:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463335.982775:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408134784:0@lo:400:kworker.0 00000100:00100000:3.0:1788463335.982785:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408134656:0@lo:400:kworker.0 00010000:00010000:0.0:1788463336.295845:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463336.491039:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408135168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463336.491135:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463336.491336:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408135168 00000100:00100000:3.0:1788463336.491346:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408135168 00000100:00100000:3.0:1788463336.491401:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788463336.491410:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fed61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408135168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463336.491448:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463336.491506:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fed61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408135168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463336.491514:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788463336.491743:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408135168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463337.163119:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463337.163290:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395568128 00000100:00100000:3.0:1788463337.163303:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395568128 00000100:00100000:3.0:1788463337.163368:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 308 00000100:00100000:3.0:1788463337.163381:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2355:x1875339395568128:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463337.163492:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2355:x1875339395568128:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 114us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463337.163499:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 308 00000100:00100000:2.0:1788463337.190833:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463337.190891:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463337.190932:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463337.190967:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395568256 00000100:00100000:2.0:1788463337.190979:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395568256 00000100:00100000:3.0:1788463337.195887:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395568640 00000100:00100000:3.0:1788463337.195910:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395568640 00000100:00100000:3.0:1788463337.196076:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 182 00000100:00100000:3.0:1788463337.196087:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2355:x1875339395568640:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463337.196179:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2355:x1875339395568640:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 94us (5246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463337.196186:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 182 00000100:00100000:3.0:1788463337.196908:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395568384 00000100:00100000:3.0:1788463337.196919:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395568384 00000100:00100000:3.0:1788463337.196980:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 106 00000100:00100000:3.0:1788463337.196989:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395568384:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463337.197036:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2355:x1875339395568384:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 48us (6144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463337.197043:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 106 00000100:00100000:3.0:1788463337.197121:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463337.200995:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395568512 00000100:00100000:3.0:1788463337.201017:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395568512 00000100:00100000:3.0:1788463337.201101:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 107 00000100:00100000:3.0:1788463337.201115:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395568512:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463337.201230:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2354:x1875339395568512:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 118us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463337.201237:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 107 00000100:00080000:2.0:1788463337.202015:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463337.202022:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788463337.202035:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463337.202114:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 183 00000100:00100000:2.0:1788463337.202131:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fee4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:2355:x1875339395568256:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463337.202202:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fee4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:2355:x1875339395568256:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 77us (11401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463337.202210:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 183 00010000:00010000:1.0:1788463337.320383:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463338.347963:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463339.365672:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463340.069314:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408135296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463340.069457:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463340.069974:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408135296 00000100:00100000:3.0:1788463340.069989:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408135296 00000100:00100000:3.0:1788463340.070101:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788463340.070113:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408135296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463340.070176:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463340.070245:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408135296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463340.070252:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788463340.070513:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463340.070564:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408135296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788463340.391893:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463341.033392:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463341.033527:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395568896 00000100:00100000:0.0:1788463341.033541:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395568896 00000100:00100000:0.0:1788463341.033642:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 66 00000100:00100000:0.0:1788463341.033661:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+19:12317:x1875339395568896:12345-192.168.204.11@tcp:35:umount.0 00000100:00100000:0.0:1788463341.034382:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:12317:x1875339395568896:12345-192.168.204.11@tcp:35:umount.0 Request processed in 721us (997us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788463341.034395:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 66 00000100:00080000:2.0:1788463341.034602:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463341.041679:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463341.043358:0:12521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395569152 00000100:00100000:1.0:1788463341.043379:0:12521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395569152 00000100:00100000:1.0:1788463341.043470:0:12521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 67 00000100:00100000:1.0:1788463341.043483:0:12521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+20:12317:x1875339395569152:12345-192.168.204.11@tcp:35:umount.0 00000100:00100000:1.0:1788463341.046466:0:12521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:12317:x1875339395569152:12345-192.168.204.11@tcp:35:umount.0 Request processed in 2961us (4783us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788463341.046489:0:12521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 67 00000100:00100000:1.0:1788463341.065482:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463341.065799:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395569408 00000100:00100000:3.0:1788463341.065816:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395569408 00000100:00100000:3.0:1788463341.065905:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 68 00000100:00100000:3.0:1788463341.065919:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5d05a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+21:12317:x1875339395569408:12345-192.168.204.11@tcp:35:umount.0 00000100:00100000:3.0:1788463341.067088:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5d05a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:12317:x1875339395569408:12345-192.168.204.11@tcp:35:umount.0 Request processed in 1160us (1614us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788463341.067106:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 68 00000100:00100000:2.0:1788463341.089786:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463341.089924:0:12521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395569664 00000100:00100000:1.0:1788463341.089958:0:12521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395569664 00000100:00100000:1.0:1788463341.090027:0:12521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 69 00000100:00100000:1.0:1788463341.090040:0:12521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:12317:x1875339395569664:12345-192.168.204.11@tcp:35:umount.0 00000100:00100000:1.0:1788463341.090565:0:12521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:12317:x1875339395569664:12345-192.168.204.11@tcp:35:umount.0 Request processed in 524us (801us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788463341.090574:0:12521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 69 00000100:00100000:0.0:1788463341.094723:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408135424:0@lo:400:kworker.0 00000100:00100000:0.0:1788463341.094867:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463341.094949:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408135936:0@lo:400:kworker.0 00000100:00100000:0.0:1788463341.094991:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463341.095030:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788463341.095037:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408135552:0@lo:400:kworker.0 00000100:00100000:0.0:1788463341.095062:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463341.095079:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408136064:0@lo:400:kworker.0 00000100:00100000:0.0:1788463341.095107:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463341.095169:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408135936 00000100:00100000:0.0:1788463341.095181:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408135936 00000100:00100000:0.0:1788463341.095259:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408135552 00000100:00100000:0.0:1788463341.095262:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408135552 00000100:00100000:0.0:1788463341.095558:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788463341.095571:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408135936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463341.095649:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8591f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408135936:12345-0@lo:400:kworker.0 Request processed in 81us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463341.095658:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788463341.095728:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788463341.095735:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408135552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463341.095763:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408135552:12345-0@lo:400:kworker.0 Request processed in 29us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463341.095953:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788463341.096015:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408135552:0@lo:400:kworker.0 00000100:00100000:0.0:1788463341.096031:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408135936:0@lo:400:kworker.0 00000100:00100000:1.0:1788463341.097634:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408135680:0@lo:400:kworker.0 00000100:00100000:1.0:1788463341.097781:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463341.097832:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463341.097839:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408135808:0@lo:400:kworker.0 00000100:00100000:1.0:1788463341.097864:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463341.098740:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408135808 00000100:00100000:2.0:1788463341.098758:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408135808 00000100:00100000:2.0:1788463341.098854:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788463341.098865:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408135808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463341.098980:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408135808:12345-0@lo:400:kworker.0 Request processed in 117us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463341.098989:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:2.0:1788463341.099019:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463341.099082:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408135808:0@lo:400:kworker.0 00000100:00100000:3.0:1788463341.099558:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408135424 00000100:00100000:3.0:1788463341.099568:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408135424 00000100:00100000:3.0:1788463341.099743:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788463341.099754:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408135424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463341.099832:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408135424:12345-0@lo:400:kworker.0 Request processed in 80us (4967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463341.099840:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788463341.100076:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408136064 00000100:00100000:3.0:1788463341.100082:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408136064 00000100:00100000:3.0:1788463341.100242:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408135680 00000100:00100000:3.0:1788463341.100246:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408135680 00000100:00100000:3.0:1788463341.100290:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788463341.100296:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408136064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463341.100333:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8591500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408136064:12345-0@lo:400:kworker.0 Request processed in 38us (5225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463341.100340:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788463341.100350:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788463341.100355:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408135680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463341.100385:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408135680:12345-0@lo:400:kworker.0 Request processed in 31us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463341.100390:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788463341.100532:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408136064:0@lo:400:kworker.0 00000100:00100000:0.0:1788463341.100558:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408135424:0@lo:400:kworker.0 00000100:00080000:2.0:1788463341.100922:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463341.100984:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463341.101005:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463341.101031:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463341.101082:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463341.101111:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395570048 00000100:00100000:2.0:1788463341.101117:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395570048 00000100:00100000:1.0:1788463341.101312:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395569920 00000100:00100000:1.0:1788463341.101317:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395569920 00000100:00100000:1.0:1788463341.101369:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395570176 00000100:00100000:1.0:1788463341.101371:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395570176 00000100:00100000:1.0:1788463341.101388:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:1.0:1788463341.101396:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+14:2355:x1875339395569920:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463341.101413:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463341.101440:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0031000/0xc3fe72277ee35973 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dcda expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.101461:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463341.101518:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+13:2355:x1875339395569920:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 122us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463341.101525:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:1.0:1788463341.101552:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:1.0:1788463341.101559:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+12:2355:x1875339395570176:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463341.101578:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463341.101588:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8ca400/0xc3fe72277ee35be9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dda5 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.101597:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463341.101616:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:2355:x1875339395570176:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 57us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463341.101622:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:1.0:1788463341.101665:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395569792 00000100:00100000:1.0:1788463341.101669:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395569792 00000100:00100000:1.0:1788463341.101731:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 73 00000100:00100000:1.0:1788463341.101738:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+5:2353:x1875339395569792:12345-192.168.204.11@tcp:9:umount.0 00000020:00000080:1.0:1788463341.102204:0:6665:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35cad 00000100:00080000:1.0:1788463341.102219:0:6665:0:(import.c:65:import_set_state_nolock()) ffff9ba5f7f70800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788463341.102277:0:6665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788463341.102765:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:2.0:1788463341.102860:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:2355:x1875339395570048:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463341.102874:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463341.102971:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8ca800/0xc3fe72277ee3593b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dca2 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463341.102988:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463341.103038:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2355:x1875339395570048:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 183us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463341.103047:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00080000:2.0:1788463341.103075:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788463341.103284:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463341.104839:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+2:2353:x1875339395569792:12345-192.168.204.11@tcp:9:umount.0 Request processed in 3088us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463341.104857:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 73 00000100:00100000:2.0:1788463341.104998:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408135680:0@lo:400:kworker.0 00000100:00100000:2.0:1788463341.117595:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463341.117742:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395570560 00000100:00100000:3.0:1788463341.117779:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395570560 00000100:00100000:3.0:1788463341.117869:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 74 00000100:00100000:3.0:1788463341.117883:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+7:2353:x1875339395570560:12345-192.168.204.11@tcp:9:umount.0 00000020:00000080:3.0:1788463341.117930:0:6668:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35f0e 00000020:00010000:3.0:1788463341.117941:0:6668:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ba5ebdea800: total 0 00000100:00080000:3.0:1788463341.117949:0:6668:0:(import.c:65:import_set_state_nolock()) ffff9ba5ebded800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788463341.118009:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1788463341.118327:0:5806:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ba5ebdea800: total 0 00010000:00010000:1.0:1788463341.118387:0:5806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ba5ebdea800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788463341.118462:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013b724d8/0xc3fe72277ee362b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df7a expref: 6 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.118507:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ade78eb1/0xc3fe72277ee3694f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e148 expref: 5 pid: 6667 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.118550:0:5806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ba5ebdea800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788463341.118564:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463341.118567:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463341.118568:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463341.119436:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+2:2353:x1875339395570560:12345-192.168.204.11@tcp:9:umount.0 Request processed in 1548us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463341.119450:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 74 00000100:00080000:2.0:1788463341.119785:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463341.138902:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463341.139102:0:8863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395571584 00000100:00100000:0.0:1788463341.139128:0:8863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395571584 00000100:00100000:0.0:1788463341.139237:0:8863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 240 00000100:00100000:0.0:1788463341.139249:0:8863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+23:2353:x1875339395571584:12345-192.168.204.11@tcp:39:umount.0 00000020:00000080:0.0:1788463341.139303:0:8863:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35949 00000020:00010000:0.0:1788463341.139331:0:8863:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ba5f7f71800: total 0 00000100:00080000:0.0:1788463341.139338:0:8863:0:(import.c:65:import_set_state_nolock()) ffff9ba4c5649800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788463341.139388:0:8863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788463341.139951:0:8863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c87dc105-ebf6-45f0-8943-2a25b33dd5b8+22:2353:x1875339395571584:12345-192.168.204.11@tcp:39:umount.0 Request processed in 699us (1066us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788463341.139963:0:8863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 240 00000020:00010000:1.0:1788463341.140300:0:7624:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ba5f7f71800: total 0 00010000:00010000:1.0:1788463341.140359:0:7624:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ba5f7f71800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1788463341.140402:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:1.0:1788463341.140406:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788463341.140417:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee35f70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dea1 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140438:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ba5c5b58700) 00010000:00010000:1.0:1788463341.140440:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463341.140444:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1a00/0xc3fe72277ee35c13 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddb3 expref: 20 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140463:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:1.0:1788463341.140466:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788463341.140469:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee3629c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df73 expref: 19 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140482:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463341.140485:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788463341.140488:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee3660e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e06f expref: 18 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140500:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463341.140518:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463341.140524:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf6e00/0xc3fe72277ee36830 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e0fb expref: 17 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140539:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463341.140541:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463341.140545:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39000/0xc3fe72277ee36925 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e13a expref: 16 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140556:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ba5d0217b00) 00010000:00010000:1.0:1788463341.140558:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788463341.140562:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0800/0xc3fe72277ee3632f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df9d expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140578:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:1.0:1788463341.140580:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788463341.140584:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38600/0xc3fe72277ee36192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df2d expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140599:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ba5c5b58300) 00010000:00010000:1.0:1788463341.140601:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788463341.140605:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0a00/0xc3fe72277ee35c83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddcf expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140622:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0c1e700) 00010000:00010000:1.0:1788463341.140624:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463341.140628:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5ca8cbe00/0xc3fe72277ee35c2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51ddba expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140660:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463341.140663:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788463341.140667:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f800/0xc3fe72277ee36902 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e133 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140739:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:1.0:1788463341.140742:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463341.140747:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36313 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df96 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140760:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ba5c519a300) 00010000:00010000:1.0:1788463341.140762:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788463341.140765:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710e600/0xc3fe72277ee3693a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e141 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140801:0:7624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ba5d0c1e300) 00010000:00010000:1.0:1788463341.140804:0:7624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463341.140808:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5e710f000/0xc3fe72277ee36272 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51df65 expref: 8 pid: 8864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463341.140822:0:7624:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ba5f7f71800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1788463341.140838:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463341.140841:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463341.140843:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463341.413847:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463341.605468:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463341.605501:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408136192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463341.605602:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463341.606381:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408136192 00000100:00100000:3.0:1788463341.606396:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408136192 00000100:00100000:3.0:1788463341.609942:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788463341.609986:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408136192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463341.610055:0:6669:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463341.610240:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408136192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 278us (4636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463341.610248:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788463341.610417:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408136192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463342.298419:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463342.298482:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463342.300920:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395571712 00000100:00100000:3.0:1788463342.300943:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395571712 00000100:00100000:3.0:1788463342.301076:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 310 00000100:00100000:3.0:1788463342.301091:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2355:x1875339395571712:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463342.301236:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2355:x1875339395571712:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 147us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463342.301246:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 310 00000100:00100000:2.0:1788463342.309776:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395571840 00000100:00100000:2.0:1788463342.309803:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395571840 00000100:00100000:2.0:1788463342.310018:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 187 00000100:00100000:2.0:1788463342.310032:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2355:x1875339395571840:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463342.310172:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2355:x1875339395571840:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 142us (11690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463342.310181:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 187 00000100:00080000:0.0:1788463342.319777:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788463342.373220:0:11682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788463342.373236:0:11682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788463342.374265:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788463342.374279:0:11682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788463342.437352:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788463342.732207:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:2.0:1788463342.732243:0:7636:0:(genops.c:885:class_export_put()) final put ffff9ba5f7f73800/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:0.0:1788463342.732343:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5f7f73800/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 for lustre-OST0001 00000020:00000080:0.0:1788463342.732425:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5f7f70800 for lustre-OST0001 00000100:00100000:1.0:1788463343.397330:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463343.397416:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463343.397614:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395571968 00000100:00100000:2.0:1788463343.397630:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395571968 00000100:00100000:2.0:1788463343.397792:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395572096 00000100:00100000:2.0:1788463343.397797:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395572096 00000100:00100000:3.0:1788463343.397820:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:3.0:1788463343.397850:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:2355:x1875339395571968:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463343.397881:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463343.397907:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0031e00/0xc3fe72277ee35a1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dcef expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463343.397929:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463343.397963:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463343.398034:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2355:x1875339395571968:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 196us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463343.398043:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395572224 00000100:00100000:0.0:1788463343.398050:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395572224 00000100:00100000:2.0:1788463343.405120:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:2.0:1788463343.405162:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+11:2355:x1875339395572096:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463343.405197:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463343.405235:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee35be2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd9e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463343.405264:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463343.406708:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+10:2355:x1875339395572096:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 1543us (9266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463343.406735:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:3.0:1788463343.407348:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:3.0:1788463343.410045:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463343.411254:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395572480 00000100:00100000:2.0:1788463343.411276:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395572480 00000100:00100000:2.0:1788463343.411381:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 241 00000100:00100000:2.0:1788463343.411394:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0abe103f-aa34-4171-b132-f3b0f4fb1586+6:2353:x1875339395572480:12345-192.168.204.11@tcp:39:umount.0 00000020:00000080:2.0:1788463343.411461:0:5818:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35a30 00000020:00010000:2.0:1788463343.411474:0:5818:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ba5feab6800: total 0 00000100:00080000:2.0:1788463343.411479:0:5818:0:(import.c:65:import_set_state_nolock()) ffff9ba5feab1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788463343.411520:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1788463343.411563:0:5806:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ba5feab6800: total 0 00010000:00010000:1.0:1788463343.411652:0:5806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ba5feab6800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788463343.411756:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5d9430200) 00010000:00010000:1.0:1788463343.411761:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463343.411776:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5efaf7e00/0xc3fe72277ee3695d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e14f expref: 6 pid: 8863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463343.411804:0:5806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ba5feab6800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788463343.411824:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463343.411827:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463343.411831:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463343.411970:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0abe103f-aa34-4171-b132-f3b0f4fb1586+3:2353:x1875339395572480:12345-192.168.204.11@tcp:39:umount.0 Request processed in 575us (1934us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788463343.411980:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 241 00000100:00100000:0.0:1788463343.414472:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:0.0:1788463343.414508:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+8:2354:x1875339395572224:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463343.414540:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463343.414572:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0030e00/0xc3fe72277ee35a22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dd19 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463343.414597:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463343.414822:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+7:2354:x1875339395572224:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 332us (16860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463343.414831:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:1.0:1788463343.436317:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463343.436498:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395572736 00000100:00100000:3.0:1788463343.436516:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395572736 00000100:00100000:3.0:1788463343.436612:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 311 00000100:00100000:3.0:1788463343.436627:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c49ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+7:2353:x1875339395572736:12345-192.168.204.11@tcp:251:umount.0 00000020:00000080:3.0:1788463343.436814:0:5809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35926 00000020:00010000:3.0:1788463343.436840:0:5809:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ba5ec407000: total 0 00000100:00080000:3.0:1788463343.436847:0:5809:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec402000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788463343.437041:0:7624:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ba5ec407000: total 0 00010000:00010000:1.0:1788463343.437047:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463343.437183:0:7624:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ba5ec407000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788463343.437224:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c1489400/0xc3fe72277ee3597a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51dce1 expref: 3 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463343.437244:0:7624:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ba5ec407000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788463343.437255:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463343.437257:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463343.437259:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463343.437837:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c49ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae+1:2353:x1875339395572736:12345-192.168.204.11@tcp:251:umount.0 Request processed in 319us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463343.437851:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 311 00000020:00000080:3.0:1788463343.437871:0:5809:0:(genops.c:885:class_export_put()) final put ffff9ba5ec407000/1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae 00000020:00000080:1.0:1788463343.438949:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5ec407000/1e1b9de6-5a58-4db8-8a32-9cdf3b5678ae for MGS 00000020:00000080:1.0:1788463343.439007:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5ec402000 for MGS 00010000:00010000:0.0:1788463343.463198:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788463344.293769:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:0.0:1788463344.293782:0:6697:0:(genops.c:885:class_export_put()) final put ffff9ba5ebdea800/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:1.0:1788463344.293901:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5ebdea800/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 for lustre-OST0000 00000020:00000080:1.0:1788463344.293975:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5ebded800 for lustre-OST0000 00000001:00100000:2.0:1788463344.305383:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000001:00080000:2.0:1788463344.305397:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1788463344.305448:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0abe103f-aa34-4171-b132-f3b0f4fb1586 00000001:00080000:2.0:1788463344.305456:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788463344.305459:0:5839:0:(genops.c:885:class_export_put()) final put ffff9ba5feab6800/0abe103f-aa34-4171-b132-f3b0f4fb1586 00000020:00000080:2.0:1788463344.305486:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5feab6800/0abe103f-aa34-4171-b132-f3b0f4fb1586 for lustre-MDT0000 00000020:00000080:2.0:1788463344.305553:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5feab1800 for lustre-MDT0000 00000020:00000080:2.0:1788463344.305575:0:5839:0:(genops.c:885:class_export_put()) final put ffff9ba5f7f71800/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 00000020:00000080:2.0:1788463344.305588:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5f7f71800/c87dc105-ebf6-45f0-8943-2a25b33dd5b8 for lustre-MDT0000 00000020:00000080:2.0:1788463344.305621:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba4c5649800 for lustre-MDT0000 00010000:00010000:0.0:1788463344.485939:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463345.189931:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788463345.189956:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408136320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463345.190056:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463345.190141:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408136320 00000100:00100000:3.0:1788463345.190149:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408136320 00000100:00100000:3.0:1788463345.190217:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788463345.190226:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408136320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463345.190267:0:6670:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463345.190316:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408136320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463345.190322:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788463345.190343:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463345.190384:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408136320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788463345.508882:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788463345.546559:0:12967:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788463345.578848:0:12967:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788463345.578928:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.578944:0:12967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.578968:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.578975:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.578997:0:12967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788463345.579004:0:12967:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788463345.579040:0:12967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788463345.579046:0:12967:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788463345.579052:0:12967:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788463345.579084:0:12967:0:(import.c:65:import_set_state_nolock()) ffff9ba5ebdda800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788463345.579176:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875339408136448:0@lo:39:umount.0 00000100:00100000:2.0:1788463345.579254:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463345.579324:0:8864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408136448 00000100:00100000:3.0:1788463345.579334:0:8864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408136448 00000100:00100000:3.0:1788463345.579391:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788463345.579402:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875339408136448:12345-0@lo:39:umount.0 00010000:00010000:1.0:1788463345.579409:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463345.579418:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463345.579426:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cb400 already unused, calling callback (ffffffffc1b62c20) 00000020:00000080:3.0:1788463345.579428:0:8864:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35735 10000000:00010000:1.0:1788463345.579431:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788463345.579439:0:8864:0:(import.c:65:import_set_state_nolock()) ffff9ba5f793e800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788463345.579441:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463345.579450:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463345.579456:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788463345.579458:0:7624:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788463345.579461:0:7624:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788463345.579549:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463345.579556:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463345.579584:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463345.579592:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb400/0xc3fe72277ee359b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee359c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463345.579603:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463345.579605:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463345.579641:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408136576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463345.579674:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463345.579732:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408136576 00000100:00100000:2.0:1788463345.579736:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408136576 00000100:00100000:2.0:1788463345.579769:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463345.579775:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c7cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3276:x1875339408136576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463345.579786:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463345.579800:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0031600/0xc3fe72277ee359c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee359b9 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463345.579812:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463345.579842:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c7cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:777dc377-0af3-4f9e-a02c-a691119a7ded+18:3276:x1875339408136576:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463345.579849:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788463345.579907:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408136576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463345.581075:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3275:x1875339408136448:12345-0@lo:39:umount.0 Request processed in 1671us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463345.581100:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788463345.581110:0:8864:0:(genops.c:885:class_export_put()) final put ffff9ba5f793a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788463345.581153:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5f793a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788463345.581203:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5f793e800 for lustre-MDT0000 00000100:00080000:2.0:1788463345.583096:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5ebdda800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788463345.583116:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875339408136448:0@lo:39:umount.0 00010000:00010000:0.0:1788463345.584112:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463345.584142:0:12967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788463345.584146:0:12967:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788463345.584153:0:12967:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788463345.585983:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.586007:0:12967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.586015:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.586022:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.586315:0:12967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463345.586324:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.586332:0:12967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.586340:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.586347:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.586383:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463345.586391:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.586398:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0031200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1788463345.586403:0:7623:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.586412:0:7623:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463345.586420:0:7623:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463345.586427:0:7623:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788463345.586430:0:7623:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788463345.586472:0:7623:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.586479:0:7623:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463345.586501:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.586510:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c0031200/0xc3fe72277ee359c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee359ce expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.586542:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463345.586546:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.586552:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489c00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1788463345.586555:0:7623:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.586562:0:7623:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463345.586569:0:7623:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463345.586575:0:7623:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788463345.586577:0:7623:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788463345.586596:0:7623:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.586602:0:7623:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463345.586622:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.586631:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463345.586634:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463345.586638:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463345.586658:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408136832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463345.586778:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463345.586876:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463345.586893:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408136704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463345.586924:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463345.586970:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408136832 00000100:00100000:3.0:1788463345.586976:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408136832 00000100:00100000:3.0:1788463345.587026:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408136704 00000100:00100000:3.0:1788463345.587029:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408136704 00000100:00100000:3.0:1788463345.587074:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463345.587086:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+19:3278:x1875339408136832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463345.587100:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463345.587117:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0030a00/0xc3fe72277ee358e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee358e0 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.587140:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463345.587186:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+18:3278:x1875339408136832:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463345.587195:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788463345.587222:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788463345.587231:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+17:3276:x1875339408136704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463345.587239:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463345.587252:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8ca200/0xc3fe72277ee359ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee359c7 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.587265:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463345.587310:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3276:x1875339408136704:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463345.587319:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788463345.587375:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:777dc377-0af3-4f9e-a02c-a691119a7ded:3276:1875339408136704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463345.587415:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:777dc377-0af3-4f9e-a02c-a691119a7ded:3278:1875339408136832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463345.588199:0:12967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788463345.588212:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c1489c00/0xc3fe72277ee358e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee358e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463345.588241:0:12967:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788463345.588255:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.588264:0:12967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.588273:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.588281:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.588328:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463345.588336:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.588343:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0000 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1788463345.588347:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.588357:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463345.588365:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463345.588371:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788463345.588373:0:5806:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788463345.588406:0:5806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.588412:0:5806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463345.588430:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.588438:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463345.588440:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463345.588442:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463345.588457:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408136960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463345.588500:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463345.588553:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408136960 00000100:00100000:3.0:1788463345.588558:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408136960 00000100:00100000:3.0:1788463345.588611:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788463345.588619:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+16:3279:x1875339408136960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463345.588630:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463345.588643:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5e710f200/0xc3fe72277ee35bdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee35bd4 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.588655:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463345.588835:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463345.588983:0:12967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788463345.588990:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0000/0xc3fe72277ee35bd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee35bdb expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463345.589001:0:12967:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788463345.589015:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463345.589025:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.589104:0:12967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.589111:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.589116:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.589129:0:12967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788463345.589132:0:12967:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788463345.589135:0:12967:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788463345.589173:0:12967:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788463345.589178:0:12967:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788463345.589183:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463345.589189:0:12967:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788463345.589194:0:12967:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ba4c513e800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463345.589199:0:12967:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ba4c54b7800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463345.589203:0:12967:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ba5fee6cd40) has exports, disconnecting them 00000020:00080000:0.0:1788463345.589214:0:12967:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ba4c513e800), last request at 1788463341 00000020:00000080:0.0:1788463345.589222:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee358a8 00000100:00080000:0.0:1788463345.589240:0:12967:0:(import.c:65:import_set_state_nolock()) ffff9ba5f7f75800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788463345.589622:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:777dc377-0af3-4f9e-a02c-a691119a7ded+15:3279:x1875339408136960:12345-0@lo:103:ldlm_bl.0 Request processed in 1002us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463345.589632:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00080000:0.0:1788463345.589988:0:12967:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ba4c513e800): rc 0 00000020:00000080:0.0:1788463345.589991:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba4c513e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788463345.590002:0:12967:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ba4c54b7800), last request at 1788463341 00000020:00000080:0.0:1788463345.590006:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee3581c 00000100:00080000:0.0:1788463345.590013:0:12967:0:(import.c:65:import_set_state_nolock()) ffff9ba4c54b1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788463345.590024:0:12967:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ba4c54b7800): rc 0 00000020:00000080:0.0:1788463345.590026:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba4c54b7800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788463345.590711:0:12967:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbaac0164fae0 00000100:00080000:0.0:1788463345.590736:0:12967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788463345.590740:0:12967:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788463345.590760:0:12967:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1788463345.590955:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463345.590966:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463345.590989:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463345.590994:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463345.591004:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463345.591012:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463345.591018:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00080000:0.0:1788463345.591018:0:12967:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 10000000:01000000:1.0:1788463345.591021:0:7624:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788463345.591025:0:7624:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788463345.591059:0:7624:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463345.591066:0:7624:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463345.591090:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463345.591098:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488200/0xc3fe72277ee35694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee3569b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463345.591114:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463345.591114:0:12967:0:(import.c:65:import_set_state_nolock()) ffff9ba4c513e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788463345.591116:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463345.591120:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463345.591131:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1788463345.591132:0:12967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788463345.591136:0:12967:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788463345.591149:0:12967:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788463345.591154:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408137088:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788463345.591217:0:12967:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788463345.591228:0:12967:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec715000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788463345.591241:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1788463345.591276:0:12967:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ba5fee6cd40) has no exports 00000100:00100000:1.0:1788463345.591312:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408137088 00000100:00100000:1.0:1788463345.591320:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408137088 00000100:00100000:0.0:1788463345.591497:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463345.591510:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+15:3277:x1875339408137088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463345.591525:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463345.591541:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cba00/0xc3fe72277ee3569b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee35694 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463345.591570:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463345.591621:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:777dc377-0af3-4f9e-a02c-a691119a7ded+14:3277:x1875339408137088:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463345.591628:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788463345.591758:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:777dc377-0af3-4f9e-a02c-a691119a7ded:3277:1875339408137088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463345.591987:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408137216:0@lo:9:umount.0 00000100:00100000:0.0:1788463345.592028:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408136960:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788463345.592125:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c513e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788463345.592178:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c54b7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788463345.592207:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5f7f75800 for lustre-MDT0000 00000020:00000080:3.0:1788463345.592212:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba4c54b1000 for lustre-MDT0000 00010000:00010000:0.0:1788463345.592370:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463345.592376:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463345.595454:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463345.595603:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408137344:0@lo:9:umount.0 00000100:00100000:2.0:1788463345.595714:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463345.601166:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408137216 00000100:00100000:0.0:1788463345.601183:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408137216 00000100:00100000:2.0:1788463345.601503:0:8660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408137344 00000100:00100000:2.0:1788463345.601508:0:8660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408137344 00000100:00100000:2.0:1788463345.601569:0:8660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788463345.601580:0:8660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875339408137216:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788463345.601631:0:8660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee3582a 00000100:00080000:2.0:1788463345.601645:0:8660:0:(import.c:65:import_set_state_nolock()) ffff9ba4c513d800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788463345.601668:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788463345.601745:0:8660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788463345.601991:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788463345.602004:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1875339408137344:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788463345.602019:0:6667:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35911 00000100:00080000:0.0:1788463345.602026:0:6667:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec401000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788463345.602049:0:6667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788463345.602394:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3275:x1875339408137344:12345-0@lo:9:umount.0 Request processed in 392us (6677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463345.602402:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788463345.602624:0:5812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788463345.602635:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788463345.603136:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec715000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788463345.603160:0:3275:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788463345.603163:0:3275:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788463345.603168:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408137344:0@lo:9:umount.0 00000100:00100000:2.0:1788463345.603484:0:8660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3275:x1875339408137216:12345-0@lo:9:umount.0 Request processed in 1905us (8043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463345.603493:0:8660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788463345.603655:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba4c513e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788463345.603664:0:3275:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788463345.603665:0:3275:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788463345.603669:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408137216:0@lo:9:umount.0 00000020:00080000:0.0:1788463345.612223:0:12967:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ba5fee6cd40) has no exports 00000020:00000080:0.0:1788463345.711130:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee356ef 00000020:00000080:0.0:1788463345.711154:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5e8be8800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788463345.711185:0:12967:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788463345.711301:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5e8be8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788463345.712363:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463345.712376:0:12967:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788463345.712381:0:12967:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ba5fee6b380) has no exports 00000020:00000080:2.0:1788463345.713557:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee356e8 00000020:00000080:2.0:1788463345.713569:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5c7d84000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788463345.713603:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c7d84000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788463345.713659:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463345.713671:0:12967:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788463345.713674:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5fee7d800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788463345.713677:0:12967:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5fee7d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788463345.713741:0:12967:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788463345.714140:0:12967:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ba5ec3972a0 - data ffff9ba5f05556c0/ffff9ba5c7c9c000 00000020:01000000:2.0:1788463345.714309:0:12967:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ba5c5bd9f00 - data ffff9ba5fa169798/ffff9ba5c2e12c00 00000001:00000004:0.0:1788463345.757922:0:12967:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1788463345.886532:0:12967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788463345.886543:0:12967:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788463345.886865:0:12967:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788463345.886868:0:12967:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788463345.891897:0:6685:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788463345.891907:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788463345.891922:0:6685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788463345.899010:0:12967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788463345.899076:0:12967:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788463345.899136:0:12967:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788463345.899139:0:12967:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788463345.905788:0:7868:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788463345.905797:0:7868:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788463345.905809:0:7868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788463345.986092:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee356b7 00000020:00000080:3.0:1788463345.986112:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5f793b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788463345.989870:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee356cc 00000020:00000080:3.0:1788463345.989888:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5fee7f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463345.991232:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5f793b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788463345.992472:0:12967:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788463345.992484:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463345.992494:0:12967:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788463345.992499:0:12967:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ba5c7d7b380) has no exports 00000004:01000000:3.0:1788463345.992734:0:12967:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788463345.992745:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee3590a 00000020:00000080:3.0:1788463345.992754:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba4c4bf0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463345.992939:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5fee7f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788463345.993009:0:12967:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788463345.993015:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463345.993033:0:12967:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788463345.993036:0:12967:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9ba4c54a8000) has no exports 00000020:00000080:3.0:1788463345.993044:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35903 00000020:00000080:3.0:1788463345.993060:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5ec715800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788463345.993132:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c4bf0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788463345.993551:0:12967:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788463345.993557:0:12967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788463345.993562:0:12967:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788463345.993570:0:12967:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788463345.993572:0:12967:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788463345.993602:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5ec715800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788463345.994444:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463345.994457:0:12967:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788463345.994465:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35797 00000020:00000080:3.0:1788463345.994472:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba4c5168800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463345.994524:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5ec715000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788463345.994532:0:8:0:(genops.c:885:class_export_put()) final put ffff9ba5ec713000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463345.994534:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5ec713000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788463345.994540:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788463345.995116:0:12967:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788463345.995124:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463345.995131:0:12967:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788463345.995136:0:12967:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ba4c5190000) has no exports 00000020:00000080:3.0:1788463345.995143:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35790 00000020:00000080:3.0:1788463345.995150:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba4c513b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788463345.995168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c5168800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1788463345.995599:0:12967:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788463345.995605:0:12967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788463345.995609:0:12967:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788463345.995616:0:12967:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788463345.995618:0:12967:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788463345.995651:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c513b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788463345.997767:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463345.997793:0:12967:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788463345.997837:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463345.997841:0:12967:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788463345.997857:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5f793d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788463345.997864:0:12967:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5f793d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788463345.997880:0:12967:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788463345.998401:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee356d3 00000020:00000080:2.0:1788463345.998410:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5fee7a000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788463345.998454:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba4c513e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788463345.998477:0:8:0:(genops.c:885:class_export_put()) final put ffff9ba4c513f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788463345.998479:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c513f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788463345.998487:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788463345.998655:0:12967:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788463345.998661:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463345.998668:0:12967:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788463345.998707:0:12967:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ba5fee68000) has no exports 00000020:00000080:2.0:1788463345.998734:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463345.998738:0:12967:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788463345.998742:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee356da 00000020:00000080:2.0:1788463345.998746:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5fee7b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788463345.998911:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5fee7a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788463345.998916:0:8:0:(genops.c:885:class_export_put()) final put ffff9ba5f793f000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788463345.998918:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5f793f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788463345.998921:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1788463345.999211:0:12967:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ba5c88d5800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788463345.999215:0:12967:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba5c88d5800 3 00000020:01000004:2.0:1788463345.999219:0:12967:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ba5c88d5800 from lustre-MDT0000 00000020:00000080:2.0:1788463345.999240:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463345.999244:0:12967:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788463345.999246:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5f7939000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788463345.999248:0:12967:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5f7939000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788463345.999267:0:12967:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788463345.999295:0:12967:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788463345.999299:0:12967:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788463345.999302:0:12967:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788463345.999305:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463345.999308:0:12967:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788463345.999315:0:12967:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9ba5e843b000 777dc377-0af3-4f9e-a02c-a691119a7ded 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788463345.999319:0:12967:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9ba5e84319c0) has exports, disconnecting them 00000020:00080000:2.0:1788463345.999324:0:12967:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ba5e843b000), last request at 1788463100 00000020:00000080:2.0:1788463345.999340:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35671 00000020:00010000:2.0:1788463345.999344:0:12967:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ba5e843b000: total 1 00000100:00080000:2.0:1788463345.999349:0:12967:0:(import.c:65:import_set_state_nolock()) ffff9ba5e843a000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788463345.999368:0:12967:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ba5e843b000): rc 0 00000020:00080000:2.0:1788463345.999372:0:12967:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9ba5e84319c0) has no exports 00000020:00010000:3.0:1788463345.999418:0:5806:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ba5e843b000: total 1 00010000:00010000:3.0:1788463345.999451:0:5806:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ba5e843b000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788463345.999481:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b1c00/0xc3fe72277ee35bcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee35bc6 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.999496:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b0e00/0xc3fe72277ee359b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee359ab expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.999505:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cb000/0xc3fe72277ee357c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee357ba expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.999532:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b0400/0xc3fe72277ee35bbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee35bb8 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.999544:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0030200/0xc3fe72277ee359dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee359d5 expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.999555:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c0031800/0xc3fe72277ee35988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee35981 expref: 4 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.999566:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b1200/0xc3fe72277ee35996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee3598f expref: 3 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.999574:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5ca8cb200/0xc3fe72277ee359a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3fe72277ee3599d expref: 2 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463345.999582:0:5806:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ba5e843b000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788463345.999595:0:5806:0:(genops.c:885:class_export_put()) final put ffff9ba5e843b000/777dc377-0af3-4f9e-a02c-a691119a7ded 00000020:00000080:1.0:1788463345.999707:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5fee7b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788463345.999787:0:5809:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ba5c9b0f600:5809] 0 exiting: rc = 1 00010000:00010000:3.0:1788463346.000450:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463346.000454:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463346.000457:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788463346.000483:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5e843b000/777dc377-0af3-4f9e-a02c-a691119a7ded for MGS 00000020:00000080:1.0:1788463346.000577:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5e843a000 for MGS 00000100:00100000:1.0:1788463346.000867:0:5810:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ba5c7c54400:5810] 1 exiting: rc = 0 00000100:00100000:0.0:1788463346.001435:0:5811:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ba5c56efe00:5811] 2 exiting: rc = 0 00000100:00100000:2.0:1788463346.002226:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002234:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002240:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002246:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002251:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002258:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002265:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002270:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002280:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002286:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002292:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002302:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002308:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002314:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002319:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002325:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002330:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002336:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002353:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002359:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002364:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002369:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002374:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002380:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002387:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002393:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002398:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002403:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002409:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002413:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002418:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002423:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002429:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002434:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002440:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002445:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002450:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002456:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002462:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002467:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002472:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002477:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002482:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002487:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002492:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002498:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002503:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002508:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002513:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002519:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002524:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002529:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002534:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002549:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002554:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002559:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002564:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002569:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002574:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002580:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002585:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002591:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002596:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.002601:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788463346.003361:0:12967:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788463346.003366:0:12967:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788463346.004435:0:12967:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ba5c2ddd7e0 - data ffff9ba5f6ec06c0/ffff9ba4c5114c00 00000020:01000000:1.0:1788463346.004566:0:12967:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ba5c8e15420 - data ffff9ba5f04905e8/ffff9ba5c7d31400 00000020:00000080:1.0:1788463346.005137:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee3565c 00000020:00000080:1.0:1788463346.005145:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5c35d1000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788463346.005161:0:12967:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ba5c88d5800 from MGS, refs=2 00000020:01000004:1.0:1788463346.005165:0:12967:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba5c88d5800 2 00000020:01000004:1.0:1788463346.005168:0:12967:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ba5c88d5800 from MGS 00000020:00000080:1.0:1788463346.005192:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463346.005199:0:12967:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788463346.005201:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5c35d1800/MGS 00000020:00000080:1.0:1788463346.005204:0:12967:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c35d1800/MGS for MGS 00000020:01000000:1.0:1788463346.005211:0:12967:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788463346.005273:0:12967:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788463346.005278:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463346.005284:0:12967:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788463346.005292:0:12967:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ba5c7d86800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788463346.005297:0:12967:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9ba5e8434d40) has exports, disconnecting them 00000020:00080000:1.0:1788463346.005303:0:12967:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ba5c7d86800), last request at 1788463101 00000020:00000080:1.0:1788463346.005322:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35727 00000020:00080000:1.0:1788463346.005333:0:12967:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ba5c7d86800): rc 0 00000020:00000080:1.0:1788463346.005338:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5c7d86800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788463346.006030:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c35d1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788463346.006043:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c7d86800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788463346.006944:0:12967:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788463346.006953:0:12967:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788463346.006959:0:12967:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788463346.006967:0:12967:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788463346.007232:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463346.007239:0:12967:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788463346.007246:0:12967:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba5c88d5800 1 00000020:00000080:2.0:1788463346.007252:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee3564e 00000020:00000080:2.0:1788463346.007258:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5c35d2800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788463346.007365:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5ebdda800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788463346.007373:0:8:0:(genops.c:885:class_export_put()) final put ffff9ba5fee5f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788463346.007376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5fee5f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788463346.007385:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1788463346.007934:0:12967:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788463346.007939:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463346.007944:0:12967:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788463346.007948:0:12967:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9ba5c7d799c0) has no exports 00000020:00000080:3.0:1788463346.008489:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c35d2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788463346.076471:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463346.076494:0:12967:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788463346.076503:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5c4da3800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788463346.076510:0:12967:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c4da3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788463346.076530:0:12967:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788463346.076779:0:12967:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ba5c98b3000 00000020:01000000:2.0:1788463346.076813:0:12967:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788463346.076833:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463346.076839:0:12967:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788463346.077167:0:12967:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9ba5c7d78000) has no exports 00000100:00100000:2.0:1788463346.077302:0:5818:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ba5f4abd400:5818] 2 exiting: rc = 0 00000100:00100000:2.0:1788463346.077434:0:5817:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ba5f4abfe00:5817] 1 exiting: rc = 0 00000100:00100000:3.0:1788463346.077715:0:5816:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ba5e854bc00:5816] 0 exiting: rc = 1 00000100:00100000:3.0:1788463346.077827:0:8863:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ba4c6e02400:8863] 3 exiting: rc = 0 00000100:00100000:3.0:1788463346.078246:0:8864:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9ba5ec77de00:8864] 4 exiting: rc = 0 00000100:00100000:2.0:1788463346.078641:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078653:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078664:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078715:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078725:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078735:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078745:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078754:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078764:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078774:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078783:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078792:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078801:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078811:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078822:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078831:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078840:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078862:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078874:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078883:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078891:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078901:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078910:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078919:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078928:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078934:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078945:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078954:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078975:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.078986:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079018:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079230:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079236:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079241:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079249:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079254:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079260:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079266:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079272:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079279:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079285:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079291:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079297:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079303:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079308:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079314:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079320:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079325:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079331:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079336:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079341:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079346:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079352:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079358:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079363:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079369:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079375:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079381:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079387:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079393:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079399:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079405:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079416:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.079424:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463346.090806:0:12521:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9ba5ec41ca00:12521] 2 exiting: rc = 0 00000100:00100000:3.0:1788463346.091113:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ba5f4abf400:5820] 1 exiting: rc = 0 00000100:00100000:0.0:1788463346.091564:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ba5f4abea00:5819] 0 exiting: rc = 1 00000100:00100000:2.0:1788463346.092331:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092358:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092369:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092377:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092384:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092391:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092399:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092406:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092414:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092423:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092430:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092441:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092459:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092467:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092474:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092479:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092484:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092489:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092495:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092500:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092505:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092520:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092525:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092530:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092539:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092547:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092555:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092563:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092569:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092577:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092585:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092593:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092600:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092608:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092616:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092622:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092637:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092642:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092649:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092654:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092659:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.092666:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093400:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093417:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093426:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093434:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093443:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093448:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093458:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093466:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093471:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093478:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093483:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093489:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093494:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093499:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093504:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093510:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093515:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093520:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093525:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093531:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093539:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.093547:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463346.094591:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ba5f4abd600:5822] 1 exiting: rc = 0 00000100:00100000:3.0:1788463346.094875:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ba5f4abcc00:5821] 0 exiting: rc = 1 00000100:00100000:2.0:1788463346.094955:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.094993:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095001:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095018:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095200:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095208:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095216:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095240:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095249:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095258:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095266:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095274:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095282:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095317:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095329:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095336:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095345:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095353:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095360:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095368:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095375:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095382:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095390:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095398:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095405:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095436:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095448:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095460:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095471:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095494:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095502:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095513:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095522:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095530:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095536:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095541:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095547:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095574:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095580:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095585:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095592:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095599:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095612:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095618:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095626:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095635:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095642:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095651:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095658:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095775:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095788:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095796:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095802:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095809:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095818:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095824:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095830:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095836:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095916:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095926:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.095934:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.096162:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.096173:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.096182:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463346.121835:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ba5f4abde00:5824] 1 exiting: rc = 0 00000100:00100000:2.0:1788463346.122134:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ba5f4abc600:5823] 0 exiting: rc = 1 00000100:00100000:3.0:1788463346.123829:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123839:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123845:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123851:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123856:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123861:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123867:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123873:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123878:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123884:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123889:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123894:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123899:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123904:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123908:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123913:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123918:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123924:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123929:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123933:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123938:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123943:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123948:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123952:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123958:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123963:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123968:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123973:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123978:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.123983:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124011:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124015:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124020:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124024:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124030:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124036:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124041:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124046:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124052:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124057:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124063:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124068:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124072:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124077:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124082:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124087:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124092:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124097:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124102:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124107:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124113:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124118:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124123:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124128:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124133:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124139:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124144:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124150:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124155:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124160:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124165:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124169:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124174:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.124179:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463346.126022:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ba5f4abc000:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1788463346.129338:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ba5f4abd200:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1788463346.130816:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130828:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130836:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130853:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130861:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130867:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130873:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130880:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130886:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130893:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130900:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130907:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130926:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130934:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130941:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130947:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130953:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130961:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130970:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130977:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130984:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130991:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.130998:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131005:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131032:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131041:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131047:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131053:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131058:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131064:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131070:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131075:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131081:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131086:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131091:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131096:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131102:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131109:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131119:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131125:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131130:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131134:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131140:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131144:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131148:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131153:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131157:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131178:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131182:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131200:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131207:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131214:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131221:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131229:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131238:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131246:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131253:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131260:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131268:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131275:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131283:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131289:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131297:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.131304:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463346.131881:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ba5c483be00:5828] 1 exiting: rc = 0 00000100:00100000:3.0:1788463346.132073:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ba5f4b7fc00:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1788463346.132336:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132344:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132351:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132358:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132367:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132374:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132382:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132389:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132397:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132404:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132412:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132419:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132427:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132435:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132442:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132449:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132456:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132463:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132486:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132493:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132501:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132508:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132515:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132522:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132530:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132539:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132549:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132557:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132566:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132572:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132577:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132583:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132587:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132592:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132600:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132606:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132622:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132628:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132634:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132640:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132644:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132649:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132655:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132661:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132667:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132929:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132939:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132946:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132954:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132963:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132971:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132979:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.132986:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133001:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133118:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133123:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133128:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133132:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133137:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133141:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133146:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133151:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133155:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788463346.133159:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.133869:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ba5f4a9fe00:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1788463346.134263:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ba5c7d45800:5829] 0 exiting: rc = 1 00000100:00100000:2.0:1788463346.135316:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ba5c7c7f000:5831] 2 exiting: rc = 0 00000100:00100000:3.0:1788463346.135654:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135663:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135678:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135707:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135713:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135719:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135725:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135857:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135865:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135871:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135878:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135884:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135891:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135897:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135904:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135910:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135916:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135936:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135944:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135950:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135956:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135963:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135969:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135975:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135982:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135988:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135993:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.135999:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136005:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136011:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136017:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136023:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136029:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136150:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136156:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136161:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136166:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136171:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136177:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136182:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136188:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136208:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136216:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136222:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136227:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136233:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136238:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136243:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136249:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136256:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136263:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136269:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136275:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136282:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136288:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136294:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136300:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136305:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136313:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136319:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136325:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136332:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136339:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463346.136345:0:12967:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788463346.146054:0:12967:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463346.146071:0:12967:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788463346.146079:0:12967:0:(genops.c:885:class_export_put()) final put ffff9ba5c2efe000/MDS_uuid 00000020:00000080:2.0:1788463346.146086:0:12967:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c2efe000/MDS_uuid for MDS 00000020:01000000:2.0:1788463346.146093:0:12967:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788463346.146242:0:12967:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1788463346.221198:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408137472:0@lo:400:kworker.0 00000400:00000100:0.0:1788463346.221269:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339408137472 offset 0 length 224: 4 00000100:00100000:0.0:1788463346.221347:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408137600:0@lo:400:kworker.0 00000400:00000100:0.0:1788463346.221368:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339408137600 offset 0 length 224: 4 00010000:00010000:0.0:1788463346.532960:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463347.560796:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788463347.816708:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788463347.816717:0:7636:0:(genops.c:885:class_export_put()) final put ffff9ba5ec407800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788463347.816826:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5ec407800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788463347.816975:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5ec401000 for lustre-OST0001 00010000:00010000:1.0:1788463348.581350:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788463349.362746:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788463349.362756:0:6697:0:(genops.c:885:class_export_put()) final put ffff9ba4c5139000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788463349.362789:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c5139000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788463349.362838:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba4c513d800 for lustre-OST0000 00000020:01000004:0.0:1788463349.599539:0:13119:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00010000:00010000:3.0:1788463349.614530:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788463349.616196:0:13119:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788463349.616258:0:13119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463349.616275:0:13119:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463349.616283:0:13119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463349.616289:0:13119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463349.616312:0:13119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788463349.616317:0:13119:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788463349.616348:0:13119:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788463349.616358:0:13119:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ba5e8590380 x1875339408137472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463362 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463349.616375:0:13119:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788463349.616381:0:13119:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788463349.616404:0:13119:0:(import.c:65:import_set_state_nolock()) ffff9ba4c54b5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788463349.616464:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875339408137728:0@lo:39:umount.0 00000400:00000100:2.0:1788463349.616530:0:3275:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339408137728 offset 0 length 224: 4 00010000:00010000:3.0:1788463349.616633:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463349.616644:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463349.616664:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488c00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1788463349.616667:0:7623:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463349.616710:0:7623:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463349.616719:0:7623:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463349.616727:0:7623:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788463349.616730:0:7623:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788463349.616732:0:7623:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788463349.616760:0:7623:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463349.616767:0:7623:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463349.616796:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463349.616803:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488c00/0xc3fe72277ee3599d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3fe72277ee359a4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463349.616816:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463349.616818:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463349.616820:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463349.616983:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408137472:0@lo:400:kworker.0 00000100:00100000:1.0:1788463349.619875:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408137856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463349.619954:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463349.620145:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408137856 00000100:00100000:3.0:1788463349.620155:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408137856 00000100:00100000:3.0:1788463349.620201:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788463349.620208:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3279:x1875339408137856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788463349.620229:0:5803:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788463349 with bad export cookie 14122850995438573169 00000100:00100000:3.0:1788463349.634557:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3279:x1875339408137856:12345-0@lo:103:ldlm_bl.0 Request processed in 14335us (14590us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788463349.634577:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788463349.634781:0:3279:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788463349.634788:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9ba5c2efd800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788463349.634792:0:3279:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788463349.650443:0:3279:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.111@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788463349.650450:0:3279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788463349.650461:0:3279:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ba5fe9ae300 x1875339408137856/t0(0) o103->MGC192.168.204.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788463365 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788463349.650477:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788463349.650480:0:3279:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788463349.650487:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788463349.650491:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9ba5c2efd800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463349.650496:0:3279:0:(import.c:545:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 132 00000100:00080000:1.0:1788463349.650519:0:3279:0:(import.c:665:import_select_connection()) MGC192.168.204.111@tcp: import ffff9ba5c2efd800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1788463349.650560:0:3279:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba4c7387100 x1875339408137984/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463349.650750:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:777dc377-0af3-4f9e-a02c-a691119a7ded:3275:1875339408137984:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788463349.650815:0:3275:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875339408137984 offset 0 length 520: 4 00000100:00100000:1.0:1788463349.651139:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:777dc377-0af3-4f9e-a02c-a691119a7ded:3279:1875339408137856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463350.629622:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463351.333011:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 777dc377-0af3-4f9e-a02c-a691119a7ded->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788463351.333024:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 777dc377-0af3-4f9e-a02c-a691119a7ded->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788463351.333179:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408138112:0@lo:400:kworker.0 00000400:00000100:2.0:1788463351.333254:0:3276:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339408138112 offset 0 length 224: 4 00010000:00010000:1.0:1788463351.652963:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463352.677214:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463353.700978:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463354.726161:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463355.364870:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 777dc377-0af3-4f9e-a02c-a691119a7ded->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788463355.364885:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 777dc377-0af3-4f9e-a02c-a691119a7ded->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788463355.365087:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408138240:0@lo:400:kworker.0 00000400:00000100:1.0:1788463355.365194:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339408138240 offset 0 length 224: 4 00010000:00010000:1.0:1788463355.749921:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463356.772931:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463357.797163:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463358.820867:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463359.014527:0:3275:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463349/real 1788463349] req@ffff9ba4c7387100 x1875339408137984/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788463359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463359.014559:0:3275:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ba4c7387100 x1875339408137984/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788463359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463359.014585:0:3275:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463349/real 1788463349] req@ffff9ba5e8593100 x1875339408137728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463359.014598:0:3275:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ba5e8593100 x1875339408137728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463359.014622:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5c2efd800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463359.014660:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788463359.014664:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:777dc377-0af3-4f9e-a02c-a691119a7ded:3275:1875339408137984:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788463359.014673:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba4c54b5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788463359.014723:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8593100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875339408137728:0@lo:39:umount.0 00000100:00080000:1.0:1788463359.014818:0:13119:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788463359.014823:0:13119:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788463359.014828:0:13119:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788463359.015726:0:13119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463359.015741:0:13119:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463359.015748:0:13119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463359.015755:0:13119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463359.015783:0:13119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463359.015790:0:13119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463359.015797:0:13119:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463359.015813:0:13119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463359.015819:0:13119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463359.015832:0:13119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788463359.015836:0:13119:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788463359.015861:0:13119:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788463359.015865:0:13119:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788463359.015871:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788463359.015877:0:13119:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788463359.015882:0:13119:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9ba5e8430000) has no exports 00000020:00080000:1.0:1788463359.015909:0:13119:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9ba5e8430000) has no exports 00000020:01000000:1.0:1788463359.017562:0:13119:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ba5ec3971e0 - data ffff9ba5f0555360/ffff9ba5c7c9f400 00010000:00010000:2.0:1788463359.017878:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463359.017888:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463359.017900:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488e00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1788463359.017904:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463359.017914:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463359.017921:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463359.017928:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788463359.017930:0:7624:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788463359.017934:0:7624:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788463359.017980:0:7624:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ba5c2efd800 00010000:00010000:2.0:1788463359.017986:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463359.017994:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488e00/0xc3fe72277ee359ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee359b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463359.018016:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463359.018020:0:7624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463359.018027:0:7624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8cb800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1788463359.018030:0:7624:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463359.018037:0:7624:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463359.018043:0:7624:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463359.018048:0:7624:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788463359.018050:0:7624:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788463359.018052:0:7624:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788463359.018058:0:7624:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ba5c2efd800 00010000:00010000:2.0:1788463359.018061:0:7624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463359.018066:0:7624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8cb800/0xc3fe72277ee35bc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee35bcd expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463359.018087:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463359.018089:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463359.018090:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463359.018900:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463359.019761:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 777dc377-0af3-4f9e-a02c-a691119a7ded->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788463359.019769:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788463359.019774:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ba5c2efd800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463359.019784:0:37:0:(import.c:545:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 381 00000100:00080000:0.0:1788463359.019790:0:37:0:(import.c:630:import_select_connection()) MGC192.168.204.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788463359.019798:0:37:0:(import.c:665:import_select_connection()) MGC192.168.204.111@tcp: import ffff9ba5c2efd800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463359.019842:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5e8591880 x1875339408138368/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463359.020243:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408138496:0@lo:400:kworker.0 00000400:00000100:0.0:1788463359.020299:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339408138496 offset 0 length 224: 4 00000100:00100000:2.0:1788463359.020457:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:777dc377-0af3-4f9e-a02c-a691119a7ded:3275:1875339408138368:0@lo:250:kworker.0 00000400:00000100:2.0:1788463359.020484:0:3275:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875339408138368 offset 0 length 520: 4 00000020:01000000:1.0:1788463359.028312:0:13119:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ba5c4ec4e40 - data ffff9ba5f049cca8/ffff9ba4c55f2400 00100000:10000000:1.0:1788463359.046375:0:13119:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788463359.088595:0:13119:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee357eb 00000020:00000080:0.0:1788463359.088607:0:13119:0:(genops.c:885:class_export_put()) final put ffff9ba4c5236000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788463359.088630:0:13119:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ba5c2e32800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788463359.088634:0:13119:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba5c2e32800 2 00000020:01000004:0.0:1788463359.088637:0:13119:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ba5c2e32800 from lustre-OST0000 00000020:00000080:0.0:1788463359.088736:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788463359.088760:0:13119:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788463359.088764:0:13119:0:(genops.c:885:class_export_put()) final put ffff9ba5ebddd000/lustre-OST0000_UUID 00000020:00000080:0.0:1788463359.088767:0:13119:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5ebddd000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788463359.088785:0:13119:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788463359.088835:0:13119:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788463359.088841:0:13119:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788463359.088845:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788463359.088851:0:13119:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788463359.088859:0:13119:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ba4c54b4800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788463359.088866:0:13119:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff9ba4c54acd40) has exports, disconnecting them 00000020:00080000:0.0:1788463359.088873:0:13119:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ba4c54b4800), last request at 1788463119 00000020:00000080:0.0:1788463359.088878:0:13119:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35815 00000020:00080000:0.0:1788463359.088888:0:13119:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ba4c54b4800): rc 0 00000020:00000080:0.0:1788463359.088894:0:13119:0:(genops.c:885:class_export_put()) final put ffff9ba4c54b4800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788463359.089651:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c5236000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788463359.089670:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c54b4800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788463359.102102:0:13119:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788463359.102112:0:13119:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788463359.102118:0:13119:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788463359.102126:0:13119:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788463359.102379:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463359.102390:0:13119:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788463359.102398:0:13119:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba5c2e32800 1 00000020:00000080:2.0:1788463359.102405:0:13119:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35758 00000020:00000080:2.0:1788463359.102417:0:13119:0:(genops.c:885:class_export_put()) final put ffff9ba5fec3c800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788463359.102440:0:13119:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788463359.102449:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463359.102454:0:13119:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788463359.102458:0:13119:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ba5e84199c0) has no exports 00000020:00000080:3.0:1788463359.102914:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba4c54b5800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788463359.102922:0:8:0:(genops.c:885:class_export_put()) final put ffff9ba5c7d87000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788463359.102925:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c7d87000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788463359.102935:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788463359.102995:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5fec3c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788463359.136947:0:13119:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463359.136966:0:13119:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788463359.136973:0:13119:0:(genops.c:885:class_export_put()) final put ffff9ba5c2e36800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788463359.136978:0:13119:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c2e36800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788463359.136986:0:13119:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788463359.137177:0:13119:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ba5c2e33800 00000020:02000400:2.0:1788463359.137233:0:13119:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788463359.850993:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463360.869592:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463361.892946:0:7624:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788463362.084791:0:3278:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463346/real 1788463346] req@ffff9ba5e8592680 x1875339408137600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463362 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463362.126248:0:3278:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ba5e8592680 x1875339408137600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788463362 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463362.126263:0:3278:0:(import.c:65:import_set_state_nolock()) ffff9ba5efad0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788463362.126268:0:3278:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788463362.155627:0:3278:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788463362.155996:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 777dc377-0af3-4f9e-a02c-a691119a7ded->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463362.156002:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 777dc377-0af3-4f9e-a02c-a691119a7ded->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788463362.156005:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788463362.156009:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788463362.156023:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ba5efad0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463362.156033:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 172 00000100:00080000:1.0:1788463362.156044:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ba5efad0800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1788463362.156081:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba4c7386680 x1875339408138624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788463362.156161:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875339408138624:0@lo:38:kworker.0 00000400:00000100:3.0:1788463362.156226:0:3275:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875339408138624 offset 0 length 520: 4 00000100:00100000:1.0:1788463362.156322:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8592680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408137600:0@lo:400:kworker.0 00000020:01000004:3.0:1788463362.620923:0:13271:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788463362.648958:0:13271:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788463362.649052:0:13271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.649069:0:13271:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.649077:0:13271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.649084:0:13271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.649126:0:13271:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788463362.649133:0:13271:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788463362.649162:0:13271:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463362.649177:0:13271:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ba5e8590a80 x1875339408138112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463367 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463362.649203:0:13271:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ba5e8593b80 x1875339408138240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463371 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463362.649217:0:13271:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ba5e8590700 x1875339408138496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463375 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463362.649228:0:13271:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ba4c7386680 x1875339408138624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788463372 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463362.649242:0:13271:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788463362.649277:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5efad0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463362.649282:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:3.0:1788463362.649286:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875339408138624:0@lo:38:kworker.0 00000100:00080000:3.0:1788463362.649317:0:13271:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788463362.649323:0:13271:0:(import.c:65:import_set_state_nolock()) ffff9ba5efad0800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788463362.649329:0:13271:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463362.649333:0:13271:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ba5e8590a80 x1875339408138112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463367 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463362.649341:0:13271:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ba5e8593b80 x1875339408138240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463371 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463362.649363:0:13271:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ba5e8590700 x1875339408138496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463375 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463362.649371:0:13271:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788463362.649381:0:13271:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1788463362.649514:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408138112:0@lo:400:kworker.0 00010000:00010000:1.0:1788463362.651211:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463362.651226:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.651239:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5ca8ca000 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463362.651244:0:5806:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.651255:0:5806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463362.651263:0:5806:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463362.651269:0:5806:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788463362.651272:0:5806:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788463362.651275:0:5806:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788463362.651297:0:5806:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ba5c2efd800 00010000:00010000:1.0:1788463362.651301:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.651310:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8ca000/0xc3fe72277ee35981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee35988 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.651323:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463362.651325:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463362.651327:0:5806:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463362.653039:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8593b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408138240:0@lo:400:kworker.0 00000100:00100000:1.0:1788463362.653190:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408138496:0@lo:400:kworker.0 00010000:00010000:3.0:1788463362.658806:0:13271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.658829:0:13271:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.658837:0:13271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.658844:0:13271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.658874:0:13271:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463362.658881:0:13271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.658887:0:13271:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.658892:0:13271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.658897:0:13271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463362.658911:0:13271:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788463362.658915:0:13271:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788463362.658939:0:13271:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788463362.658943:0:13271:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788463362.658949:0:13271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463362.658973:0:13271:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788463362.658978:0:13271:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ba5fe6919c0) has no exports 00000020:00080000:3.0:1788463362.659006:0:13271:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ba5fe6919c0) has no exports 00010000:00010000:1.0:1788463362.660929:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463362.660944:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.660956:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030c00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463362.660960:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.660972:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463362.660981:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463362.660986:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788463362.660989:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788463362.660992:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788463362.661012:0:5805:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ba5c2efd800 00010000:00010000:1.0:1788463362.661016:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.661024:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c0030c00/0xc3fe72277ee3598f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee35996 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.661036:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463362.661041:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.661047:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710ee00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463362.661068:0:5805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.661076:0:5805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463362.661082:0:5805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463362.661086:0:5805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788463362.661089:0:5805:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788463362.661090:0:5805:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788463362.661096:0:5805:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ba5c2efd800 00010000:00010000:1.0:1788463362.661099:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.661105:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5e710ee00/0xc3fe72277ee35bb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee35bbf expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.661120:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463362.661122:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463362.661124:0:5805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463362.662466:0:7623:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788463362.664153:0:13271:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ba5ec3975a0 - data ffff9ba5fa387000/ffff9ba5fee30c00 00000020:01000000:3.0:1788463362.664341:0:13271:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ba5c4bfeba0 - data ffff9ba5f6e735e8/ffff9ba4c6cd5c00 00100000:10000000:0.0:1788463362.689057:0:13271:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788463362.721668:0:13271:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35877 00000020:00000080:1.0:1788463362.721681:0:13271:0:(genops.c:885:class_export_put()) final put ffff9ba5f7f70000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788463362.721789:0:13271:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ba4c5230000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788463362.721794:0:13271:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba4c5230000 2 00000020:01000004:1.0:1788463362.721798:0:13271:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ba4c5230000 from lustre-OST0001 00000020:00000080:1.0:1788463362.721833:0:13271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788463362.721844:0:13271:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788463362.721847:0:13271:0:(genops.c:885:class_export_put()) final put ffff9ba5f7f73000/lustre-OST0001_UUID 00000020:00000080:1.0:1788463362.721851:0:13271:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5f7f73000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788463362.721860:0:13271:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788463362.722012:0:13271:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 777dc377-0af3-4f9e-a02c-a691119a7ded->MGS 00010000:00010000:1.0:1788463362.722030:0:13271:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488400/0xc3fe72277ee357ba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee357c8 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463362.722042:0:13271:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488400/0xc3fe72277ee357ba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee357c8 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463362.722048:0:13271:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788463362.722051:0:13271:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788463362.722054:0:13271:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788463362.722068:0:13271:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ba5c2efd800 00010000:00010000:1.0:1788463362.722072:0:13271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5c1488400/0xc3fe72277ee357ba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee357c8 expref: -99 pid: 6663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463362.722089:0:13271:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8caa00/0xc3fe72277ee359d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3fe72277ee359dc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463362.722095:0:13271:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8caa00/0xc3fe72277ee359d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3fe72277ee359dc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463362.722100:0:13271:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788463362.722102:0:13271:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788463362.722104:0:13271:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788463362.722113:0:13271:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ba5c2efd800 00010000:00010000:1.0:1788463362.722116:0:13271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5ca8caa00/0xc3fe72277ee359d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3fe72277ee359dc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788463362.722134:0:13271:0:(import.c:65:import_set_state_nolock()) ffff9ba5c2efd800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788463362.722138:0:13271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788463362.722141:0:13271:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788463362.722143:0:13271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788463362.722148:0:13271:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788463362.722166:0:13271:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ba5e8591880 x1875339408138368/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788463374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788463362.722183:0:13271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788463362.722186:0:13271:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1788463362.722283:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:777dc377-0af3-4f9e-a02c-a691119a7ded:3275:1875339408138368:0@lo:250:kworker.0 10000000:01000000:1.0:1788463362.723226:0:13271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788463362.723239:0:13271:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee3566a 00000020:00000080:1.0:1788463362.723246:0:13271:0:(genops.c:885:class_export_put()) final put ffff9ba5c2efd000/777dc377-0af3-4f9e-a02c-a691119a7ded 00000020:00000080:2.0:1788463362.725479:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5f7f70000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788463362.726631:0:13271:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.111@tcp (flags='') 00000020:00000080:2.0:1788463362.727248:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c2efd000/777dc377-0af3-4f9e-a02c-a691119a7ded for MGC192.168.204.111@tcp 00000020:00000080:2.0:1788463362.727276:0:13271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463362.727286:0:13271:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.111@tcp: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788463362.727292:0:13271:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9ba5c7d7cd40) has no exports 10000000:01000000:3.0:1788463362.727373:0:5813:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788463362.727533:0:13271:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.111@tcp: client import never connected 00000100:00080000:2.0:1788463362.727538:0:13271:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788463362.727542:0:13271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788463362.727546:0:13271:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788463362.727548:0:13271:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788463362.727611:0:13271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788463362.727618:0:13271:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.111@tcp (uuid 777dc377-0af3-4f9e-a02c-a691119a7ded) 00000020:01000000:2.0:1788463362.727627:0:13271:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788463362.727631:0:13271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788463362.727636:0:13271:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788463362.727643:0:13271:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ba4c5138000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788463362.727648:0:13271:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9ba5fe694d40) has exports, disconnecting them 00000020:00080000:2.0:1788463362.727653:0:13271:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ba4c5138000), last request at 1788463140 00000020:00000080:2.0:1788463362.727658:0:13271:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee358a1 00000020:00080000:2.0:1788463362.727675:0:13271:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ba4c5138000): rc 0 00000020:00000080:2.0:1788463362.727679:0:13271:0:(genops.c:885:class_export_put()) final put ffff9ba4c5138000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788463362.728485:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5c2efd800 for MGC192.168.204.111@tcp 00000020:00000080:3.0:1788463362.728495:0:8:0:(genops.c:885:class_export_put()) final put ffff9ba5c2efb800/777dc377-0af3-4f9e-a02c-a691119a7ded 00000020:00000080:3.0:1788463362.728498:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5c2efb800/777dc377-0af3-4f9e-a02c-a691119a7ded for MGC192.168.204.111@tcp 00000020:01000000:3.0:1788463362.728508:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.111@tcp (777dc377-0af3-4f9e-a02c-a691119a7ded) 00000020:00000080:3.0:1788463362.728826:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c5138000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788463362.729743:0:13271:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788463362.729749:0:13271:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788463362.729753:0:13271:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788463362.729760:0:13271:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788463362.729861:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ba5efad0800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788463362.730786:0:7624:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788463362.730991:0:5806:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788463362.731115:0:5805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1788463362.731243:0:7623:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788463362.731410:0:5801:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ba5c8ccd800:5801] 1 exiting: rc = 0 00000100:00100000:1.0:1788463362.731570:0:5800:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ba5c4c45a00:5800] 0 exiting: rc = 1 00000100:00100000:1.0:1788463362.732765:0:6681:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9ba4c508ce00:6681] 2 exiting: rc = 0 00000100:00100000:3.0:1788463362.733930:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.734229:0:5803:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ba5c483b600:5803] 1 exiting: rc = 0 00000100:00100000:3.0:1788463362.734314:0:5802:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ba5c8ccca00:5802] 0 exiting: rc = 1 00000100:00100000:1.0:1788463362.735455:0:5804:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ba5c483a600:5804] 2 exiting: rc = 0 00000100:00100000:1.0:1788463362.735544:0:8442:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ba5ec4d4a00:8442] 3 exiting: rc = 0 00000100:00100000:3.0:1788463362.735733:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735744:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735751:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735756:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735763:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735768:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735774:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735779:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735785:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735791:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735815:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735820:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735826:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735832:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735837:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735845:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735851:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735856:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735861:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735865:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735870:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735875:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735880:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735884:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735889:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735894:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735899:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735904:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735908:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735913:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735918:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735923:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735928:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735933:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735938:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735943:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735947:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735952:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735957:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735962:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735967:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735973:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735978:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735983:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.735989:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736000:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736006:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736011:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736016:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736021:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736025:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736030:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736035:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736040:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736046:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736051:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736056:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736061:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736066:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736072:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736077:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736083:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736089:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.736094:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788463362.739092:0:13271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463362.739103:0:13271:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788463362.739111:0:13271:0:(genops.c:885:class_export_put()) final put ffff9ba5f7f74800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788463362.739116:0:13271:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5f7f74800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788463362.739122:0:13271:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788463362.739172:0:13271:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba4c5230000 1 00000020:00000080:3.0:1788463362.739178:0:13271:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc3fe72277ee35846 00000020:00000080:3.0:1788463362.739184:0:13271:0:(genops.c:885:class_export_put()) final put ffff9ba4c513c800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788463362.739204:0:13271:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788463362.739209:0:13271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463362.739214:0:13271:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788463362.739218:0:13271:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9ba5e8433380) has no exports 00000020:00000080:1.0:1788463362.739520:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c513c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788463362.760995:0:13271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463362.761015:0:13271:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788463362.761022:0:13271:0:(genops.c:885:class_export_put()) final put ffff9ba4c5234800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788463362.761038:0:13271:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba4c5234800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788463362.761049:0:13271:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788463362.761263:0:13271:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ba4c5233000 00000020:01000000:3.0:1788463362.761290:0:13271:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788463362.761295:0:13271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788463362.761301:0:13271:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788463362.761306:0:13271:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9ba5fee699c0) has no exports 00000020:00000080:3.0:1788463362.761343:0:13271:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788463362.761425:0:13271:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788463362.761430:0:13271:0:(genops.c:885:class_export_put()) final put ffff9ba5fec3f800/OSS_uuid 00000020:00000080:3.0:1788463362.761433:0:13271:0:(genops.c:844:class_export_destroy()) destroying export ffff9ba5fec3f800/OSS_uuid for OSS 00000020:01000000:3.0:1788463362.761438:0:13271:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788463362.761526:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ba5feaf0200:6665] 0 exiting: rc = 1 00000100:00100000:3.0:1788463362.761634:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ba5c7c55800:6668] 2 exiting: rc = 0 00000100:00100000:3.0:1788463362.761731:0:8660:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ba5c8534a00:8660] 3 exiting: rc = 0 00000100:00100000:0.0:1788463362.762001:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ba5fec78800:6667] 1 exiting: rc = 0 00000100:00100000:3.0:1788463362.762186:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762195:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762201:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762209:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762214:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762220:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762225:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762231:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762237:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762243:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762249:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762255:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762262:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762267:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762273:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762278:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762283:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762289:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762294:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762309:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762315:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762321:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762326:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762331:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762337:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762342:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762362:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762369:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762374:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762380:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762385:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762390:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762395:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762401:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762406:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762411:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762416:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762421:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762426:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762431:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762436:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762441:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762446:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762451:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762456:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762461:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762466:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762471:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762476:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762482:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762486:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762491:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762496:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762500:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762513:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762518:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762523:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762528:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762534:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762539:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762544:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762549:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762554:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.762560:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.763411:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ba5fe40c200:6669] 0 exiting: rc = 1 00000100:00080000:3.0:1788463362.766539:0:5812:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788463362.767516:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ba5e8578a00:6670] 1 exiting: rc = 0 00000100:00100000:3.0:1788463362.767705:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767720:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767726:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767732:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767738:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767743:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767748:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767753:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767759:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767765:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767770:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767776:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767782:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767787:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767792:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767797:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767802:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767807:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767812:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767817:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767821:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767826:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767831:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767850:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767856:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767862:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767867:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767873:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767878:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767883:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767888:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767892:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767898:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767902:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767907:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767912:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767916:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767921:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767926:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767931:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767950:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767956:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767961:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767967:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767972:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767977:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767982:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767987:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767991:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.767996:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768001:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768005:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768010:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768015:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768020:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768024:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768029:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768033:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768044:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768049:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768054:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768059:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768064:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.768068:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.769047:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ba5e8579c00:6671] 0 exiting: rc = 1 00000100:00100000:3.0:1788463362.769204:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ba5fe40dc00:6673] 2 exiting: rc = 0 00000100:00100000:1.0:1788463362.772893:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ba5fe40d000:6672] 1 exiting: rc = 0 00000100:00100000:3.0:1788463362.773137:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773149:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773157:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773168:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773177:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773188:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773196:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773204:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773214:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773222:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773231:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773240:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773265:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773276:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773285:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773294:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773302:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773310:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773319:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773329:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773337:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773344:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773366:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773374:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773383:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773391:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773398:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773421:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773430:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773438:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773445:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773450:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773456:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773463:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773469:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773475:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773498:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773505:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773511:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773517:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773522:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773528:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773534:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773540:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773546:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773552:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773557:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773563:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773569:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773575:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773580:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773585:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773593:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773599:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773607:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773615:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773625:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773632:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773640:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773648:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773656:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773665:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773702:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.773710:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.786884:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ba5fe40ca00:6674] 0 exiting: rc = 1 00000100:00100000:1.0:1788463362.788582:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ba5fe40d400:6675] 1 exiting: rc = 0 00000100:00100000:3.0:1788463362.788882:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788892:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788897:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788902:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788907:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788913:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788918:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788923:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788928:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788933:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788938:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788944:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788948:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788953:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788958:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788962:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788967:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788975:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788981:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788986:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788991:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.788996:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789001:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789007:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789014:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789019:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789025:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789031:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789036:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789041:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789046:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789052:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789079:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789085:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789091:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789096:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789101:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789107:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789113:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789118:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789123:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789128:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789134:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789139:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789144:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789150:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789156:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789161:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789166:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789171:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789176:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789184:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789189:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789195:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789200:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789206:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789211:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789217:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789223:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789228:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789234:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789240:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789245:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.789251:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788463362.792647:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ba5d0253800:6676] 0 exiting: rc = 1 00000100:00100000:1.0:1788463362.794955:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ba5c578b800:6677] 1 exiting: rc = 0 00000100:00100000:3.0:1788463362.799451:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799465:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799473:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799497:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799504:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799513:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799533:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799543:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799549:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799557:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799567:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799576:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799583:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799590:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799597:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799603:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799610:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799617:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799644:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799651:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799659:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799666:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799673:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799681:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799706:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799713:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799722:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799729:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799736:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799743:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799767:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799776:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799784:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799792:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799799:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799805:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799811:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799817:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799833:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799838:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799844:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799851:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799876:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799884:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799891:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799898:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799904:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799911:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799918:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799925:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799933:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799939:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799945:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799953:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799976:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799984:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799990:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.799996:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.800003:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.800008:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.800014:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.800021:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.800028:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788463362.800043:0:13271:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788463362.822260:0:13271:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788463380.784630:0:13890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788463390.824763:0:14350:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788463390.824770:0:14350:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788463390.824936:0:14350:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ba5ebded800 00000020:01000004:3.0:1788463390.824955:0:14350:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788463390.824967:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788463390.824989:0:14350:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ba4c5193380) 00000020:00000080:3.0:1788463390.825013:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788463390.867605:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788463390.873506:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788463390.873979:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1788463390.874066:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1788463390.874235:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788463390.874292:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1788463390.874376:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788463390.874459:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788463390.874548:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788463390.876569:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1788463390.877821:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 277: rc = 0 00100000:10000000:0.0:1788463390.877920:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 277: rc = 0 00100000:10000000:0.0:1788463390.878276:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 482: rc = 0 00100000:10000000:0.0:1788463390.878513:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 482: rc = 0 00100000:10000000:0.0:1788463390.878941:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 482: rc = 0 00100000:10000000:0.0:1788463390.880511:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 482: rc = 0 00100000:10000000:0.0:1788463390.881074:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 482: rc = 0 00100000:10000000:0.0:1788463390.881534:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 482: rc = 0 00100000:10000000:0.0:1788463390.882025:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 482: rc = 0 00100000:10000000:0.0:1788463390.882261:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 482: rc = 0 00100000:10000000:0.0:1788463390.883928:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 482: rc = 0 00100000:10000000:0.0:1788463390.884217:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 482: rc = 0 00100000:10000000:0.0:1788463390.894258:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 482: rc = 0 00100000:10000000:0.0:1788463390.894969:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 482: rc = 0 00100000:10000000:0.0:1788463390.896201:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 650: rc = 0 00100000:10000000:0.0:1788463390.896945:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 650: rc = 0 00100000:10000000:0.0:1788463390.897204:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 650: rc = 0 00100000:10000000:0.0:1788463390.897836:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 650: rc = 0 00100000:10000000:0.0:1788463390.898082:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 650: rc = 0 00100000:10000000:0.0:1788463390.898422:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 650: rc = 0 00100000:10000000:0.0:1788463390.899059:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 650: rc = 0 00100000:10000000:0.0:1788463390.899376:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 650: rc = 0 00100000:10000000:0.0:1788463390.899922:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 650: rc = 0 00100000:10000000:0.0:1788463390.900199:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 650: rc = 0 00100000:10000000:0.0:1788463390.901179:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 650: rc = 0 00100000:10000000:0.0:1788463390.901816:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 650: rc = 0 00100000:10000000:0.0:1788463390.902071:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 650: rc = 0 00100000:10000000:0.0:1788463390.902415:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 650: rc = 0 00100000:10000000:0.0:1788463390.903571:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 650: rc = 0 00100000:10000000:0.0:1788463390.904864:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 650: rc = 0 00100000:10000000:0.0:1788463390.905129:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 650: rc = 0 00100000:10000000:0.0:1788463390.906245:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 650: rc = 0 00100000:10000000:0.0:1788463390.910316:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 650: rc = 0 00100000:10000000:0.0:1788463390.910987:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 650: rc = 0 00100000:10000000:0.0:1788463390.911280:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 650: rc = 0 00100000:10000000:0.0:1788463390.912413:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 650: rc = 0 00100000:10000000:0.0:1788463390.913004:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 650: rc = 0 00100000:10000000:0.0:1788463390.913256:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 650: rc = 0 00100000:10000000:0.0:1788463390.913539:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 650: rc = 0 00100000:10000000:0.0:1788463390.914048:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 650: rc = 0 00100000:10000000:0.0:1788463390.914302:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 650: rc = 0 00100000:10000000:0.0:1788463390.914960:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 650: rc = 0 00100000:10000000:0.0:1788463390.915211:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 650: rc = 0 00100000:10000000:0.0:1788463390.919797:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 650: rc = 0 00100000:10000000:0.0:1788463390.920356:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 650: rc = 0 00100000:10000000:0.0:1788463390.921057:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 650: rc = 0 00100000:10000000:2.0:1788463390.926539:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 625: rc = 0 00100000:10000000:2.0:1788463390.928899:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788463390.929136:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 278: rc = 0 00100000:10000000:2.0:1788463390.929371:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788463390.929439:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 278: rc = 0 00100000:10000000:2.0:1788463390.929626:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788463390.929818:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 278: rc = 0 00100000:10000000:2.0:1788463390.930211:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788463390.930276:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 281: rc = 0 00100000:10000000:2.0:1788463390.931944:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788463390.932047:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 281: rc = 0 00100000:10000000:2.0:1788463390.932341:0:14350:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788463390.932411:0:14350:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 281: rc = 0 00000020:00000080:2.0:1788463390.932945:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788463390.932955:0:14350:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788463390.932967:0:14350:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee3696b 00000020:01000004:2.0:1788463390.932990:0:14350:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788463390.932996:0:14350:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788463390.933001:0:14350:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ba5ebded800 from MGS 00000020:01000004:2.0:1788463390.933006:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788463390.933016:0:14350:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ba5fe690000) 00000020:00000080:2.0:1788463390.933027:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788463390.933084:0:14350:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba5ebded800 from MGS, refs=2 00080000:01000000:2.0:1788463390.933089:0:14350:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788463390.933094:0:14350:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee36979 00000100:00100000:2.0:1788463390.933190:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788463390.933584:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788463390.933590:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788463390.937313:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788463390.937329:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788463390.938471:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463390.939510:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788463390.939519:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788463390.940522:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788463390.940532:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788463390.943389:0:14350:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788463390.943405:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788463390.945194:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463390.945199:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463390.945201:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463390.946535:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463390.946540:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463390.946559:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463390.947417:0:14350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788463390.955751:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788463390.972857:0:14350:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788463390.972883:0:14350:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788463390.972886:0:14350:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788463390.982045:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788463390.982272:0:14350:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788463390.982597:0:14350:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788463390.989055:0:14350:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788463390.989437:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463390.991837:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788463390.991851:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788463391.005927:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788463391.005942:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788463391.006452:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788463391.006461:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788463391.007996:0:14364:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1788463391.008146:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788463391.008171:0:14350:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.111@tcp' 00000020:01000004:0.0:1788463391.008173:0:14350:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788463391.008203:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.111@tcp (typ=mgc) 00000020:00000080:0.0:1788463391.008217:0:14350:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.111@tcp (ffff9ba4c54ab380) 00000020:00000080:0.0:1788463391.008235:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788463391.008306:0:14350:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ba5ec045800@MGC192.168.204.111@tcp: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1788463391.008490:0:14350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.111@tcp-0 is initialized 00000040:01000000:0.0:1788463391.008498:0:14350:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788463391.020000:0:14365:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788463391.020137:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.111@tcp (uuid b647fa9f-8776-4850-826f-89ba9b699661) 00000020:00000080:1.0:1788463391.020171:0:14350:0:(genops.c:1385:class_connect()) connect: client b647fa9f-8776-4850-826f-89ba9b699661, cookie 0xc3fe72277ee36987 00000100:00080000:1.0:1788463391.020183:0:14350:0:(import.c:545:import_select_connection()) MGC192.168.204.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463391.020190:0:14350:0:(import.c:665:import_select_connection()) MGC192.168.204.111@tcp: import ffff9ba5ec045800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1788463391.020231:0:14350:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba4c7385c00 x1875339408138752/t0(0) o250->MGC192.168.204.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463391.020259:0:14350:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b647fa9f-8776-4850-826f-89ba9b699661->MGS 00000020:01000004:1.0:1788463391.020280:0:14350:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788463391.020284:0:14350:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788463391.020297:0:14350:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ba5e841cd40) 00000020:00000080:1.0:1788463391.020307:0:14350:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788463391.022281:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b647fa9f-8776-4850-826f-89ba9b699661:3275:1875339408138752:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788463391.022360:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463391.022477:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408138752 00000100:00100000:2.0:1788463391.022488:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408138752 00000100:00100000:2.0:1788463391.022529:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463391.022547:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3275:x1875339408138752:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788463391.022577:0:14361:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b647fa9f-8776-4850-826f-89ba9b699661@0@lo t0 exp 0000000000000000 cur 422 last 0 00000020:00000080:2.0:1788463391.022603:0:14361:0:(genops.c:1385:class_connect()) connect: client b647fa9f-8776-4850-826f-89ba9b699661, cookie 0xc3fe72277ee36995 00000100:00080000:2.0:1788463391.022788:0:14361:0:(import.c:65:import_set_state_nolock()) ffff9ba4c5230800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463391.022856:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+5:3275:x1875339408138752:12345-0@lo:250:mount.lustre.0 Request processed in 308us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463391.022865:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463391.022933:0:3275:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788463391.022943:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.111@tcp: connect to target with instance 0 00000100:00080000:2.0:1788463391.022952:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788463391.022957:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788463391.022960:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5ec045800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788463391.022963:0:3275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788463391.022971:0:3275:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788463391.022976:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b647fa9f-8776-4850-826f-89ba9b699661:3275:1875339408138752:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788463391.039008:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463391.039256:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463391.039264:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788463391.041181:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788463391.041194:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788463391.041645:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788463391.041652:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788463391.042481:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463391.042647:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788463391.042652:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788463391.043275:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788463391.043283:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788463391.079020:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463391.079538:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788463391.079546:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788463391.083951:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788463391.083967:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788463391.084519:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463391.084771:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788463391.084777:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788463391.086867:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788463391.086883:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788463391.087636:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463391.087849:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788463391.087854:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788463391.088296:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788463391.088302:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788463391.089028:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463391.089202:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788463391.089214:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788463391.090064:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788463391.090074:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788463391.131227:0:14350:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788463391.131619:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788463391.131626:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788463391.139127:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788463391.139151:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788463391.141027:0:14350:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788463391.141056:0:14350:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788463391.148791:0:14350:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788463391.148844:0:14350:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788463391.148854:0:14350:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788463391.149313:0:14350:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788463391.149365:0:14350:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.111@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788463391.149370:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788463391.149372:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788463391.149374:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463391.149375:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463391.149380:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463391.149381:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463391.149383:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463391.149384:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788463391.149386:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463391.149387:0:14350:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788463391.149390:0:14350:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788463391.149392:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788463391.149393:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788463391.149394:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463391.149395:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463391.149396:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463391.149397:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463391.149398:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463391.149398:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788463391.149399:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463391.149400:0:14350:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788463391.149435:0:14350:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788463391.149461:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408138880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788463391.149556:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.149715:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c93bfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463391.155564:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408138880 00000100:00100000:0.0:1788463391.155584:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408138880 00000100:00100000:0.0:1788463391.155719:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463391.155735:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+5:14350:x1875339408138880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788463391.155847:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788463391.155850:0:14363:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788463391.155854:0:14363:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788463391.159135:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788463391.159760:0:14363:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788463391.163792:0:14385:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788463391.163814:0:14385:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788463391.163834:0:14385:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788463391.163872:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788463391.164856:0:14363:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788463391.164869:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788463391.203812:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+5:14350:x1875339408138880:12345-0@lo:253:mount.lustre.0 Request processed in 48060us (54233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463391.203843:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463391.206210:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408138880:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788463391.206237:0:14350:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788463391.206240:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788463391.206242:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788463391.206244:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463391.206245:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463391.206246:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463391.206248:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463391.206249:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463391.206251:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788463391.206252:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463391.206254:0:14350:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788463391.206285:0:14350:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ba5ebded800 from lustre-MDT0000 10000000:01000000:1.0:1788463391.206595:0:14350:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788463391.206599:0:14350:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788463391.206604:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ba4c54ab380 10000000:01000000:1.0:1788463391.206623:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463391.206634:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ba4c54ab380 from 1 10000000:01000000:1.0:1788463391.206637:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788463391.206806:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.206898:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.206913:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463391.206941:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463391.207097:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.207237:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c93bfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463391.208011:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408139008 00000100:00100000:3.0:1788463391.208021:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408139008 00000100:00100000:3.0:1788463391.208091:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463391.208105:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+5:14350:x1875339408139008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463391.208128:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463391.208160:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b1200/0xc3fe72277ee369a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee3699c expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463391.208197:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b1200/0xc3fe72277ee369a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee3699c expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463391.208213:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b1200/0xc3fe72277ee369a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee3699c expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463391.208224:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1200, rc 0) 00000100:00100000:3.0:1788463391.209491:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+6:14350:x1875339408139008:12345-0@lo:101:mount.lustre.0 Request processed in 1380us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463391.209505:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463391.209560:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463391.209591:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369a3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.209602:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee369a3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463391.209704:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463391.209753:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.209788:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c93bfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463391.209804:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408139136 00000100:00100000:3.0:1788463391.209811:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408139136 00000100:00100000:3.0:1788463391.209859:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463391.209868:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+6:14350:x1875339408139136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463391.210197:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+6:14350:x1875339408139136:12345-0@lo:501:mount.lustre.0 Request processed in 329us (444us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463391.210206:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463391.210231:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139136:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788463391.210260:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788463391.210341:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369a3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.210360:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369a3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463391.210370:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ba5ebded800 10000000:01000000:1.0:1788463391.210375:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788463391.210379:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ba5ebded800 10000000:01000000:1.0:1788463391.210381:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788463391.210385:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ba5ebded800 from 1 10000000:01000000:1.0:1788463391.210388:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788463391.210421:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6000/0xc3fe72277ee369aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.210429:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6000/0xc3fe72277ee369aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.210439:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6000/0xc3fe72277ee369aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463391.210453:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463391.210483:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.210505:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c93bfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463391.210640:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408139264 00000100:00100000:0.0:1788463391.210645:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408139264 00000100:00100000:0.0:1788463391.210722:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463391.210732:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+6:14350:x1875339408139264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463391.210742:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463391.210763:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5e710e600/0xc3fe72277ee369b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee369aa expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463391.210784:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5e710e600/0xc3fe72277ee369b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee369aa expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463391.210805:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5e710e600/0xc3fe72277ee369b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee369aa expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463391.210815:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710e600, rc 0) 00000100:00100000:0.0:1788463391.210860:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+7:14350:x1875339408139264:12345-0@lo:101:mount.lustre.0 Request processed in 130us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463391.210873:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788463391.212507:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463391.212539:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6000/0xc3fe72277ee369aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369b1 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.212551:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6000/0xc3fe72277ee369aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee369b1 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463391.212598:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788463391.216143:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6000/0xc3fe72277ee369aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369b1 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.216161:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6000/0xc3fe72277ee369aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369b1 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463391.216171:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788463391.216182:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463391.216189:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ba5ebded800 10000000:01000000:1.0:1788463391.216191:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788463391.216195:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788463391.216198:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788463391.216237:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6a00/0xc3fe72277ee369b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.216246:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6a00/0xc3fe72277ee369b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.216257:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6a00/0xc3fe72277ee369b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463391.216508:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463391.216603:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.216739:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c93bfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463391.219777:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408139392 00000100:00100000:2.0:1788463391.219793:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408139392 00000100:00100000:2.0:1788463391.220086:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463391.220114:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+7:14350:x1875339408139392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463391.220133:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463391.220158:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5f7d38400/0xc3fe72277ee369bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee369b8 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463391.220192:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5f7d38400/0xc3fe72277ee369bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee369b8 expref: 8 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463391.220206:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5f7d38400/0xc3fe72277ee369bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee369b8 expref: 8 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463391.220216:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38400, rc 0) 00000100:00100000:2.0:1788463391.220447:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+8:14350:x1875339408139392:12345-0@lo:101:mount.lustre.0 Request processed in 336us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463391.220455:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788463391.220567:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463391.220588:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6a00/0xc3fe72277ee369b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369bf expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.220607:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6a00/0xc3fe72277ee369b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee369bf expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463391.220680:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463391.220734:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.224115:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c93bfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788463391.229074:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408139520 00000100:00100000:0.0:1788463391.229099:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408139520 00000100:00100000:0.0:1788463391.229185:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463391.229197:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c370b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+8:14350:x1875339408139520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463391.231618:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c370b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+9:14350:x1875339408139520:12345-0@lo:501:mount.lustre.0 Request processed in 2416us (10877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.231635:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463391.232106:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463391.232165:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8591f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463391.232222:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463391.232262:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4a9cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.232434:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408139648 00000100:00100000:1.0:1788463391.232441:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408139648 00000100:00100000:1.0:1788463391.232473:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463391.232481:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c3709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+9:14350:x1875339408139648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463391.232862:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c3709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+9:14350:x1875339408139648:12345-0@lo:503:mount.lustre.0 Request processed in 380us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.232870:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788463391.233085:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8591f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408139648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463391.246584:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14386:1875339408139776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463391.246724:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463391.246771:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4a9ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.248487:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408139776 00000100:00100000:1.0:1788463391.248501:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408139776 00000100:00100000:1.0:1788463391.248573:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463391.248586:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c3709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+9:14386:x1875339408139776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463391.250502:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c3709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+9:14386:x1875339408139776:12345-0@lo:502:llog_process_th.0 Request processed in 1912us (3772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.250515:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788463391.250680:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8591f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14386:1875339408139776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788463391.250742:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463391.250754:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463391.250756:0:14386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788463391.250762:0:14386:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788463391.250765:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788463391.250781:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ba4c54a99c0) 00000020:00000080:0.0:1788463391.250812:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788463391.250818:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788463391.250906:0:14386:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788463391.250913:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee369cd 00000020:00000080:1.0:1788463391.254667:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788463391.254781:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463391.259696:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.259706:0:14386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788463391.259719:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463391.259729:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.259731:0:14386:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788463391.259738:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463391.259758:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ba5fe693380) 00000020:00000080:2.0:1788463391.259785:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788463391.259790:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788463391.259792:0:14386:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788463391.259806:0:14386:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788463391.259817:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788463391.259903:0:14386:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba5ebded800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788463391.259915:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ba5fe694d40) 00000020:00000080:2.0:1788463391.259929:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788463391.260014:0:14386:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788463391.260026:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3fe72277ee369e2 00000020:00000080:2.0:1788463391.260173:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788463391.260179:0:14386:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788463391.260184:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc3fe72277ee369e9 00080000:01000000:2.0:1788463391.260190:0:14386:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788463391.260194:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee369f0 00010000:00010000:3.0:1788463391.383257:0:14386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788463391.383675:0:14386:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788463391.383883:0:14386:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788463391.384356:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ba4c51919c0) 00000020:00000080:3.0:1788463391.384375:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788463391.384433:0:14386:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788463391.384447:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee369fe 00000020:00000080:1.0:1788463391.397458:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788463391.427584:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc3fe72277ee36a05 00000020:00000080:2.0:1788463391.428018:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788463391.428030:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463391.428036:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.428038:0:14386:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788463391.428041:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788463391.428044:0:14386:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788463391.428045:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788463391.428047:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788463391.428048:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788463391.428050:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.428051:0:14386:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788463391.428054:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463391.428058:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.428060:0:14386:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788463391.428064:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788463391.428102:0:14386:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788463391.428120:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463391.428122:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.428124:0:14386:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788463391.428126:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788463391.428130:0:14386:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788463391.428133:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.428134:0:14386:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788463391.428137:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788463391.428142:0:14386:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:2.0:1788463391.428168:0:14386:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788463391.428170:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463391.428193:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ba5fe6919c0) 00000020:00000080:2.0:1788463391.428206:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788463391.428211:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788463391.428257:0:14386:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788463391.428261:0:14386:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788463391.428267:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee36a13 00010000:00080000:2.0:1788463391.428309:0:14386:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ba5efad4000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:2.0:1788463391.428539:0:14386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788463391.428974:0:14386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788463391.429023:0:14386:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788463391.430018:0:14386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463391.430086:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788463391.430155:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788463391.434038:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788463391.434047:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788463391.435358:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788463391.435376:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788463391.435423:0:14386:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788463391.435450:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3fe72277ee36a1a 00000100:00080000:1.0:1788463391.435465:0:14386:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788463391.435472:0:14386:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ba5efad4000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1788463391.435525:0:14386:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba4c7387480 x1875339408139904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788463391.435557:0:14386:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788463391.435714:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463391.435718:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463391.435720:0:14386:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788463391.435722:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788463391.435725:0:14386:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788463391.435727:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788463391.435728:0:14386:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788463391.435730:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788463391.435731:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463391.435733:0:14386:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788463391.435735:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788463391.435738:0:14386:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788463391.435742:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463391.435743:0:14386:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788463391.435746:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788463391.435751:0:14386:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.111@tcp to nid 0x20000c0a8cc6f (192.168.204.111@tcp) 00000020:01000000:1.0:1788463391.435782:0:14386:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788463391.435784:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788463391.435806:0:14386:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ba5e8418000) 00000020:00000080:1.0:1788463391.435817:0:14386:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788463391.435835:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788463391.435922:0:14386:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788463391.435928:0:14386:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788463391.435934:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3fe72277ee36a28 00010000:00080000:1.0:1788463391.435964:0:14386:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ba5c7de7800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:1.0:1788463391.436169:0:14386:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788463391.436380:0:14386:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788463391.436405:0:14386:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788463391.437123:0:14386:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463391.437203:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788463391.437282:0:14386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1788463391.437914:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408139904:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788463391.437982:0:3275:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339408139904 offset 0 length 520: 4 00000100:00100000:1.0:1788463391.438406:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b647fa9f-8776-4850-826f-89ba9b699661:3279:1875339408140032:0@lo:400:kworker.0 00000100:00100000:1.0:1788463391.438459:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788463391.440170:0:14392:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788463391.440187:0:14392:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788463391.445483:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408140032 00000100:00100000:3.0:1788463391.445500:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408140032 00000100:00100000:3.0:1788463391.445583:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788463391.445594:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c370a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+9:3279:x1875339408140032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463391.445979:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c370a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+9:3279:x1875339408140032:12345-0@lo:400:kworker.0 Request processed in 385us (7517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463391.445987:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788463391.446095:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b647fa9f-8776-4850-826f-89ba9b699661:3279:1875339408140032:0@lo:400:kworker.0 00000020:00000080:0.0:1788463391.446565:0:14386:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788463391.446582:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788463391.446631:0:14386:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788463391.446665:0:14386:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3fe72277ee36a2f 00000100:00080000:0.0:1788463391.446674:0:14386:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463391.446680:0:14386:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ba5c7de7800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463391.446756:0:14386:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5e8591f80 x1875339408140160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463391.446782:0:14386:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788463391.446855:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463391.446860:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463391.446862:0:14386:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788463391.446864:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463391.446868:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463391.446870:0:14386:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788463391.446872:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788463391.446874:0:14386:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788463391.446876:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463391.446879:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463391.446880:0:14386:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788463391.446882:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463391.446884:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463391.446885:0:14386:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788463391.446888:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788463391.446921:0:14386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8593800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14386:1875339408140288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463391.446998:0:14386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463391.447030:0:14386:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.447246:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408140288 00000100:00100000:1.0:1788463391.447254:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408140288 00000100:00100000:1.0:1788463391.447303:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463391.447316:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c3709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+9:14386:x1875339408140288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463391.447739:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c3709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+9:14386:x1875339408140288:12345-0@lo:502:llog_process_th.0 Request processed in 321us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.447748:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463391.447826:0:14386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8593800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14386:1875339408140288:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788463391.447864:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788463391.447872:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788463391.447873:0:14386:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788463391.447883:0:14386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:3.0:1788463391.448405:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408140160:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788463391.448459:0:3275:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339408140160 offset 0 length 520: 4 00000020:01000000:3.0:1788463391.449094:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788463391.449135:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788463391.449160:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6a00/0xc3fe72277ee369b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369bf expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463391.449174:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6a00/0xc3fe72277ee369b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369bf expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463391.449182:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ba5ebded800 from 1 10000000:01000000:3.0:1788463391.449186:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463391.449232:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463391.449241:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463391.449253:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463391.449272:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408140416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788463391.449310:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463391.449343:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c12ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.449408:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408140416 00000100:00100000:1.0:1788463391.449417:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408140416 00000100:00100000:1.0:1788463391.449468:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463391.449478:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c3708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+9:14350:x1875339408140416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463391.449499:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463391.449514:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5efaf6800/0xc3fe72277ee36a3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36a36 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.449538:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5efaf6800/0xc3fe72277ee36a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36a36 expref: 10 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.449550:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5efaf6800/0xc3fe72277ee36a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36a36 expref: 10 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.449559:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf6800, rc 0) 00000100:00100000:1.0:1788463391.449595:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c3708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+10:14350:x1875339408140416:12345-0@lo:101:mount.lustre.0 Request processed in 119us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.449602:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463391.450008:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408140416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463391.450023:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463391.450032:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463391.450580:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408140544:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788463391.455916:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463391.456018:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c12ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463391.459105:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408140544 00000100:00100000:0.0:1788463391.459152:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408140544 00000100:00100000:0.0:1788463391.459258:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788463391.459270:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c3708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+10:14350:x1875339408140544:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788463391.459301:0:14362:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788463391.459308:0:14362:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788463391.459998:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c3708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+10:14350:x1875339408140544:12345-0@lo:256:mount.lustre.0 Request processed in 726us (4086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463391.460008:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463391.460104:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408140544:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788463391.460764:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788463391.460802:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463391.460814:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463391.460824:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5ebded800 from 1 10000000:01000000:2.0:1788463391.460827:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463391.460879:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463391.460888:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463391.460899:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463391.460921:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408140672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463391.460964:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463391.462084:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9249a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.462318:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408140672 00000100:00100000:1.0:1788463391.462327:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408140672 00000100:00100000:1.0:1788463391.462373:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788463391.462382:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+10:14350:x1875339408140672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463391.462399:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463391.462419:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5efaf6c00/0xc3fe72277ee36a4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36a44 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.462448:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5efaf6c00/0xc3fe72277ee36a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36a44 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.462459:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5efaf6c00/0xc3fe72277ee36a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36a44 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.462468:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf6c00, rc 0) 00000100:00100000:1.0:1788463391.462537:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14350:x1875339408140672:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.462544:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788463391.463222:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408140672:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463391.463241:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463391.463251:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463391.463322:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408140800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463391.463360:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463391.463387:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9249a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.466815:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408140800 00000100:00100000:1.0:1788463391.466842:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408140800 00000100:00100000:1.0:1788463391.466932:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463391.466946:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14350:x1875339408140800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463391.467539:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14350:x1875339408140800:12345-0@lo:501:mount.lustre.0 Request processed in 594us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.467547:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463391.467896:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408140800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463391.467951:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408140928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463391.468000:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463391.468031:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9249a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.468234:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408140928 00000100:00100000:1.0:1788463391.468240:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408140928 00000100:00100000:1.0:1788463391.468267:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463391.468274:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14350:x1875339408140928:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463391.468428:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14350:x1875339408140928:12345-0@lo:503:mount.lustre.0 Request processed in 153us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.468435:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463391.468520:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408140928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463391.475985:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14394:1875339408141056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463391.476087:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463391.476130:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.476183:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408141056 00000100:00100000:1.0:1788463391.476192:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408141056 00000100:00100000:1.0:1788463391.476240:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463391.476251:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14394:x1875339408141056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463391.476556:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14394:x1875339408141056:12345-0@lo:502:llog_process_th.0 Request processed in 305us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.476565:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463391.476855:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14394:1875339408141056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463391.476886:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463391.476896:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.476899:0:14394:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788463391.476906:0:14394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba5ebded800 00000020:00000080:2.0:1788463391.476909:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788463391.476917:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463391.476920:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.476921:0:14394:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788463391.476924:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463391.476926:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.476927:0:14394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788463391.476931:0:14394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba5ebded800 00000020:00000080:2.0:1788463391.476933:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788463391.476995:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463391.476999:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.477000:0:14394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788463391.477003:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788463391.477005:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.477007:0:14394:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788463391.477010:0:14394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ba5ebded800 00000020:00000080:2.0:1788463391.477013:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788463391.477050:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14394:1875339408141184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463391.477085:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463391.477114:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c92499c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.477165:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408141184 00000100:00100000:1.0:1788463391.477171:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408141184 00000100:00100000:1.0:1788463391.477205:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788463391.477221:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14394:x1875339408141184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788463391.477349:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14394:x1875339408141184:12345-0@lo:502:llog_process_th.0 Request processed in 129us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.477356:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788463391.483670:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14394:1875339408141184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788463391.483768:0:14394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788463391.483776:0:14394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463391.483779:0:14394:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788463391.483783:0:14394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788463391.490453:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788463391.490505:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788463391.490534:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.490551:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463391.490631:0:14350:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788463391.490634:0:14350:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ba5ebded800 10000000:01000000:1.0:1788463391.490725:0:14350:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ba5ebded800 10000000:01000000:1.0:1788463391.490731:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463391.490738:0:14350:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba5ebded800 from 1 10000000:01000000:1.0:1788463391.490741:0:14350:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788463391.490784:0:14350:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7800/0xc3fe72277ee36a52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.490804:0:14350:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7800/0xc3fe72277ee36a52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.490816:0:14350:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7800/0xc3fe72277ee36a52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463391.490842:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408141312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463391.490923:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.490978:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c52e7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.491010:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408141312 00000100:00100000:1.0:1788463391.491017:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408141312 00000100:00100000:1.0:1788463391.491068:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463391.491078:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14350:x1875339408141312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463391.491091:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463391.491103:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5efaf7e00/0xc3fe72277ee36a59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36a52 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.491125:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5efaf7e00/0xc3fe72277ee36a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36a52 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.491135:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5efaf7e00/0xc3fe72277ee36a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36a52 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.491144:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf7e00, rc 0) 00000100:00100000:1.0:1788463391.491181:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+12:14350:x1875339408141312:12345-0@lo:101:mount.lustre.0 Request processed in 104us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.491188:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463391.491234:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408141312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463391.491248:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7800/0xc3fe72277ee36a52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a59 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.491257:0:14350:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7800/0xc3fe72277ee36a52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36a59 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463391.491301:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408141440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463391.491324:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.491344:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c52e7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463391.492880:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408141440 00000100:00100000:0.0:1788463391.492896:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408141440 00000100:00100000:0.0:1788463391.492961:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788463391.492975:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:14350:x1875339408141440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463391.493329:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:14350:x1875339408141440:12345-0@lo:501:mount.lustre.0 Request processed in 357us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463391.493336:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788463391.493457:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408141440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463391.493508:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408141568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463391.493554:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.493587:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c52e7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788463391.493835:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408141568 00000100:00100000:0.0:1788463391.493840:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408141568 00000100:00100000:0.0:1788463391.493875:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788463391.493882:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:14350:x1875339408141568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463391.494036:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:14350:x1875339408141568:12345-0@lo:503:mount.lustre.0 Request processed in 154us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463391.494043:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788463391.494128:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408141568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463391.503885:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14398:1875339408141696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463391.503986:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463391.504033:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408141696 00000100:00100000:0.0:1788463391.504042:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408141696 00000100:00100000:0.0:1788463391.504108:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463391.504127:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:14398:x1875339408141696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463391.504488:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:14398:x1875339408141696:12345-0@lo:502:llog_process_th.0 Request processed in 359us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463391.504497:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463391.504553:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463391.504576:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14398:1875339408141696:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788463391.504644:0:14398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788463391.504668:0:14398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ba4c54acd40) 00000020:00000080:0.0:1788463391.504721:0:14398:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788463391.504827:0:14398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba5ebded800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788463391.504833:0:14398:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ba5ebded800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788463391.504837:0:14398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba5ebded800 4 00010000:00080000:0.0:1788463391.504875:0:14398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ba5c7d84000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1788463391.506533:0:14398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788463391.514536:0:14398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788463391.514595:0:14398:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788463391.514620:0:14398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc3fe72277ee36a67 00000100:00080000:0.0:1788463391.514638:0:14398:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463391.514646:0:14398:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ba5c7d84000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463391.514714:0:14398:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5e8590000 x1875339408141824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463391.514758:0:14398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788463391.518222:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8592a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14398:1875339408141952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788463391.518310:0:14398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463391.518341:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c89cd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788463391.518391:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408141952 00000100:00100000:2.0:1788463391.518401:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408141952 00000100:00100000:2.0:1788463391.518459:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463391.518470:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:14398:x1875339408141952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788463391.518823:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:14398:x1875339408141952:12345-0@lo:502:llog_process_th.0 Request processed in 355us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463391.518832:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463391.519058:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8592a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b647fa9f-8776-4850-826f-89ba9b699661:14398:1875339408141952:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788463391.519111:0:14398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:3.0:1788463391.519411:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875339408141824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788463391.519459:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788463391.520907:0:14350:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788463391.520940:0:14350:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788463391.520967:0:14350:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7800/0xc3fe72277ee36a52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a59 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.520981:0:14350:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7800/0xc3fe72277ee36a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a59 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788463391.521036:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788463391.521038:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788463391.521039:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463391.521041:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463391.521042:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463391.521043:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463391.521044:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463391.521046:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788463391.521048:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463391.521049:0:14350:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463391.521054:0:14350:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788463391.521057:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788463391.521059:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788463391.521060:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463391.521061:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463391.521062:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463391.521064:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463391.521065:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463391.521066:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788463391.521072:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463391.521073:0:14350:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788463391.521098:0:14350:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788463391.521119:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408142080:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788463391.521180:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.521225:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c852b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788463391.521272:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408141824 00000100:00100000:1.0:1788463391.521282:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408141824 00000100:00100000:1.0:1788463391.521323:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463391.521330:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875339408141824:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788463391.521385:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875339408141824:12345-0@lo:38:llog_process_th.0 Request processed in 53us (1925us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788463391.521392:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463391.521414:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408142080 00000100:00100000:1.0:1788463391.521417:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408142080 00000100:00100000:1.0:1788463391.521446:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463391.521452:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+12:14350:x1875339408142080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788463391.521489:0:14363:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788463391.521504:0:14363:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788463391.524811:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788463391.524828:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7d84000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463391.524835:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788463391.524840:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875339408141824:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788463391.586070:0:14363:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788463391.586091:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788463391.586502:0:14384:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788463391.586508:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788463391.586532:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.586552:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5efaf6800/0xc3fe72277ee36a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36a36 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.586561:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.586603:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5efaf6800/0xc3fe72277ee36a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee36a36 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.586632:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba5efaf6800/0xc3fe72277ee36a3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee36a36 expref: 12 pid: 14363 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463391.586648:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7386a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1875339408142208:0@lo:104: 00000100:00100000:1.0:1788463391.586752:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.586801:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c2dfe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463391.586876:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408142208 00000100:00100000:0.0:1788463391.586883:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408142208 00000100:00100000:0.0:1788463391.586933:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463391.586941:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b647fa9f-8776-4850-826f-89ba9b699661+3:14384:x1875339408142208:12345-0@lo:104: 00010000:00010000:0.0:1788463391.586955:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463391.587006:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463391.587012:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b647fa9f-8776-4850-826f-89ba9b699661+3:14384:x1875339408142208:12345-0@lo:104: Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463391.587019:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463391.587138:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7386a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1875339408142208:0@lo:104: 00010000:00010000:2.0:1788463391.587159:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587506:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463391.587512:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587519:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0400 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1788463391.587523:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587531:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788463391.587537:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463391.587543:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788463391.587581:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587587:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788463391.587614:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587620:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0400/0xc3fe72277ee36a36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a3d expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587645:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463391.587647:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463391.587649:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463391.587668:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788463391.587679:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b647fa9f-8776-4850-826f-89ba9b699661:3277:1875339408142336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788463391.587741:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463391.587799:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408142336 00000100:00100000:1.0:1788463391.587804:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408142336 00010000:00010000:1.0:1788463391.587823:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5efaf6800/0xc3fe72277ee36a3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36a36 expref: 13 pid: 14363 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463391.587850:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463391.587858:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+13:3277:x1875339408142336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463391.587871:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463391.587876:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5efaf6800/0xc3fe72277ee36a3d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36a36 expref: 13 pid: 14363 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587887:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5efaf6800/0xc3fe72277ee36a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee36a36 expref: 13 pid: 14363 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587900:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5efaf6800/0xc3fe72277ee36a3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee36a36 expref: 13 pid: 14363 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587913:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587922:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788463391.587945:0:14353:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001437482s 00010000:00010000:1.0:1788463391.587951:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587958:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587965:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587971:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587976:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6600 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463391.587980:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587987:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.587999:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463391.588009:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463391.588040:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+12:3277:x1875339408142336:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463391.588047:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463391.588073:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b647fa9f-8776-4850-826f-89ba9b699661:3277:1875339408142336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463391.588337:0:14384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463391.588346:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463391.588351:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36a6e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463391.609979:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14350:x1875339408142080:12345-0@lo:253:mount.lustre.0 Request processed in 88517us (88789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463391.609995:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463391.610114:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:14350:1875339408142080:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788463391.610338:0:14350:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788463391.610342:0:14350:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788463391.610344:0:14350:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788463391.610345:0:14350:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463391.610347:0:14350:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463391.610348:0:14350:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463391.610349:0:14350:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463391.610350:0:14350:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788463391.610352:0:14350:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788463391.610354:0:14350:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463391.610355:0:14350:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788463391.610373:0:14350:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788463391.618601:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788463391.618852:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788463391.619127:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788463391.619284:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788463391.619527:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788463391.619679:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788463391.621366:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788463391.621536:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788463391.621853:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788463391.622044:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788463391.622390:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788463391.622548:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788463391.722188:0:14350:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788463391.722945:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788463391.723186:0:14406:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788463391.723190:0:14406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788463391.723586:0:14407:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788463391.723674:0:14407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463391.733121:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788463391.734056:0:14407:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788463391.734065:0:14407:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788463391.741599:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788463391.741769:0:14350:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788463391.742203:0:14350:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788463391.742212:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788463391.743122:0:14350:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463391.744826:0:14350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788463391.745632:0:14350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788463391.745721:0:14350:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788463391.749385:0:14350:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788463391.765830:0:14350:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788463391.820996:0:14350:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788463391.821036:0:14350:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbaac00d9b988 00100000:10000000:2.0:1788463391.821044:0:14350:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788463391.822324:0:14350:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788463391.822341:0:14350:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788463391.822354:0:14350:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788463391.822393:0:14350:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788463391.980838:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788463392.550558:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788463392.613076:0:14365:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788463392.613088:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ba5ebded800 from 6 10000000:01000000:1.0:1788463392.613094:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788463392.613161:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463392.613192:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463392.613205:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463392.613235:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408142464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788463392.614189:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463392.614252:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec148e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463392.614718:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408142464 00000100:00100000:0.0:1788463392.614728:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408142464 00000100:00100000:0.0:1788463392.614799:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788463392.614810:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+11:14365:x1875339408142464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463392.614828:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463392.614844:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5e710f000/0xc3fe72277ee36a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36a75 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463392.614880:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5e710f000/0xc3fe72277ee36a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36a75 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463392.614912:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5e710f000/0xc3fe72277ee36a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36a75 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463392.614922:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f000, rc 0) 00000100:00100000:0.0:1788463392.614979:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:14365:x1875339408142464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463392.614985:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788463392.615283:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408142464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463392.615302:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463392.615313:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463392.615395:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408142592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788463392.615433:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463392.615462:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e1142180 going to sleep for 11 seconds 00000100:00100000:1.0:1788463392.615579:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408142592 00000100:00100000:1.0:1788463392.615584:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408142592 00000100:00100000:1.0:1788463392.615611:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463392.615617:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:14365:x1875339408142592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788463392.615631:0:14361:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788463392.615647:0:14361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788463392.615650:0:14361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788463392.615764:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:14365:x1875339408142592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463392.615789:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788463392.615825:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408142592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788463392.615998:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788463392.616007:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463392.616016:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463393.004847:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788463393.577038:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788463394.021356:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463395.047065:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463396.069047:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463396.900847:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463396.900855:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463396.900859:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463396.900862:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463396.900864:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788463396.900867:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788463396.900870:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7d84000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463396.900883:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ba5c7d84000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463396.900905:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5e8590000 x1875339408142848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463396.900936:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463396.900952:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408142720:0@lo:400:kworker.0 00000100:00100000:0.0:1788463396.901042:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463396.901113:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875339408142848:0@lo:38:kworker.0 00000100:00100000:0.0:1788463396.901166:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463396.901212:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408142720 00000100:00100000:0.0:1788463396.901222:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408142720 00000100:00100000:0.0:1788463396.901274:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463396.901283:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:3276:x1875339408142720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463396.901342:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:3276:x1875339408142720:12345-0@lo:400:kworker.0 Request processed in 60us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463396.901349:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463396.901410:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8592a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408142720:0@lo:400:kworker.0 00000100:00100000:3.0:1788463396.903934:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408142848 00000100:00100000:3.0:1788463396.903950:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408142848 00000100:00100000:3.0:1788463396.903989:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463396.904002:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3275:x1875339408142848:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788463396.904036:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:3.0:1788463396.904087:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc3fe72277ee36a83 00000004:00100000:3.0:1788463396.904108:0:14370:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788463396.904272:0:14370:0:(import.c:65:import_set_state_nolock()) ffff9ba5c2f6b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788463396.904371:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8593800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875339408142848:12345-0@lo:38:kworker.0 Request processed in 369us (3203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463396.904380:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788463396.906493:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ba5e8590000 x1875339408142848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463396.906526:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788463396.906537:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788463396.906545:0:3275:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788463396.906550:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7d84000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463396.906559:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875339408142848:0@lo:38:kworker.0 00010000:00010000:3.0:1788463397.093640:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788463397.490964:0:14650:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788463398.117116:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463399.141103:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463400.167146:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788463401.184204:0:14801:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9cda9c50 20000000:00000080:0.0:1788463401.184221:0:14801:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ba5c8190800 uarg=0000000000000000 20000000:01000000:0.0:1788463401.184254:0:14801:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788463401.184261:0:14801:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788463401.184267:0:14801:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00010000:00010000:3.0:1788463401.189435:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463401.192994:0:14802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788463401.194090:0:14801:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788463401.207339:0:14801:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788463401.207484:0:14801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463401.207509:0:14801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5efaf6c00/0xc3fe72277ee36a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36a44 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463401.207594:0:14801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463401.207664:0:14801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5efaf6c00/0xc3fe72277ee36a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee36a44 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463401.207728:0:14801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba5efaf6c00/0xc3fe72277ee36a4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee36a44 expref: 11 pid: 14363 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463401.207749:0:14801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14801:1875339408142976:0@lo:104: 00000100:00100000:0.0:1788463401.207903:0:14801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463401.207986:0:14801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5d27a7300 going to sleep for 11 seconds 00000100:00100000:2.0:1788463401.209337:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408142976 00000100:00100000:2.0:1788463401.209353:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408142976 00000100:00100000:2.0:1788463401.209417:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463401.209431:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8592a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b647fa9f-8776-4850-826f-89ba9b699661+3:14801:x1875339408142976:12345-0@lo:104: 00010000:00010000:2.0:1788463401.209457:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463401.209583:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788463401.209591:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8592a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b647fa9f-8776-4850-826f-89ba9b699661+3:14801:x1875339408142976:12345-0@lo:104: Request processed in 163us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463401.209599:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788463401.209651:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463401.209659:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463401.209671:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38000 already unused, calling callback (ffffffffc1b62c20) 00000100:00100000:0.0:1788463401.209672:0:14801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14801:1875339408142976:0@lo:104: 10000000:00010000:2.0:1788463401.209677:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463401.209719:0:14801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463401.209723:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788463401.209736:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463401.209742:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788463401.209792:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463401.209804:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788463401.209841:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463401.209849:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38000/0xc3fe72277ee36a44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a4b expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463401.209882:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463401.209884:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463401.209886:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463401.209911:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788463401.209933:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b647fa9f-8776-4850-826f-89ba9b699661:3279:1875339408143104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463401.210493:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463401.215419:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408143104 00000100:00100000:1.0:1788463401.215441:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408143104 00010000:00010000:1.0:1788463401.215513:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5efaf6c00/0xc3fe72277ee36a4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36a44 expref: 12 pid: 14363 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463401.215581:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463401.215594:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+12:3279:x1875339408143104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788463401.215624:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463401.215631:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5efaf6c00/0xc3fe72277ee36a4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36a44 expref: 12 pid: 14363 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215650:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5efaf6c00/0xc3fe72277ee36a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee36a44 expref: 12 pid: 14363 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215672:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5efaf6c00/0xc3fe72277ee36a4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee36a44 expref: 12 pid: 14363 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215710:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215720:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215738:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215745:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215766:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215772:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215778:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463401.215782:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215791:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215814:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463401.215827:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463401.215919:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+11:3279:x1875339408143104:12345-0@lo:103:ldlm_bl.0 Request processed in 328us (5428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463401.215928:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788463401.216302:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b647fa9f-8776-4850-826f-89ba9b699661:3279:1875339408143104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463401.216437:0:14801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463401.216447:0:14801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463401.216454:0:14801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5e710e200/0xc3fe72277ee36a8a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463402.021004:0:3275:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463391/real 1788463391] req@ffff9ba5e8591f80 x1875339408140160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463401 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463402.021057:0:3275:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ba5e8591f80 x1875339408140160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463401 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463402.021069:0:3275:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463391/real 1788463391] req@ffff9ba4c7387480 x1875339408139904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463401 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463402.021101:0:3275:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ba4c7387480 x1875339408139904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463401 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788463402.021161:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463402.021172:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788463402.021176:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408140160:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788463402.021183:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5efad4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788463402.021187:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788463402.021190:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408139904:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788463402.023377:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788463402.023756:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463402.023791:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b647fa9f-8776-4850-826f-89ba9b699661:3278:1875339408143232:0@lo:400:kworker.0 00000100:00100000:0.0:1788463402.023924:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463402.024198:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408143232 00000100:00100000:3.0:1788463402.024212:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408143232 00000100:00100000:3.0:1788463402.024279:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788463402.024292:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+11:3278:x1875339408143232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463402.024376:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+11:3278:x1875339408143232:12345-0@lo:400:kworker.0 Request processed in 86us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463402.024398:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788463402.024482:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b647fa9f-8776-4850-826f-89ba9b699661:3278:1875339408143232:0@lo:400:kworker.0 00000100:00080000:2.0:1788463402.028210:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788463402.028217:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ba5efad4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463402.028230:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:2.0:1788463402.028238:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788463402.028267:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ba5efad4000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1788463402.028326:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5c328f480 x1875339408143360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463402.028359:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463402.028364:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788463402.028366:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788463402.028371:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:2.0:1788463402.028374:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788463402.028378:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ba5c7de7800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1788463402.029052:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5c328ce00 x1875339408143488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463402.029147:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463402.029173:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408143616:0@lo:400:kworker.0 00000100:00100000:2.0:1788463402.029280:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463402.029359:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408143616 00000100:00100000:2.0:1788463402.029368:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408143616 00000100:00100000:2.0:1788463402.029522:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463402.029533:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408143616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463402.029615:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408143616:12345-0@lo:400:kworker.0 Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463402.029624:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788463402.029900:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ba5c328d880 x1875339408143616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463402.029919:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408143616:0@lo:400:kworker.0 00000100:00100000:0.0:1788463402.030203:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408143360:0@lo:8:kworker.0 00000400:00000100:0.0:1788463402.030254:0:3275:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339408143360 offset 0 length 520: 4 00000100:00100000:0.0:1788463402.030292:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408143488:0@lo:8:kworker.0 00000400:00000100:0.0:1788463402.030318:0:3275:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875339408143488 offset 0 length 520: 4 00010000:00010000:3.0:1788463402.213111:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788463402.791020:0:14365:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463402.791052:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5ebded800 from 10 10000000:01000000:2.0:1788463402.791058:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463402.791124:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463402.791140:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463402.791154:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463402.791187:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408143744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463402.791294:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463402.791362:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c56e8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463402.791397:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408143744 00000100:00100000:2.0:1788463402.791406:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408143744 00000100:00100000:2.0:1788463402.791471:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788463402.791482:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+11:14365:x1875339408143744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463402.791499:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463402.791517:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5f7d39600/0xc3fe72277ee36a98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36a91 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463402.791548:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5f7d39600/0xc3fe72277ee36a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36a91 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463402.791561:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5f7d39600/0xc3fe72277ee36a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36a91 expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463402.791583:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39600, rc 0) 00000100:00100000:2.0:1788463402.791626:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+12:14365:x1875339408143744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463402.791653:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788463402.791757:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408143744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463402.791774:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463402.791785:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463402.791850:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408143872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463402.791877:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463402.791893:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c56e8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463402.791905:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408143872 00000100:00100000:2.0:1788463402.791908:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408143872 00000100:00100000:2.0:1788463402.791929:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463402.791935:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:14365:x1875339408143872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463402.792252:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:14365:x1875339408143872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463402.792260:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788463402.792288:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408143872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463402.792326:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408144000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463402.792362:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463402.792373:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c56e8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463402.792385:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408144000 00000100:00100000:2.0:1788463402.792388:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408144000 00000100:00100000:2.0:1788463402.792426:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788463402.792438:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:14365:x1875339408144000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463402.792602:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:14365:x1875339408144000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463402.792610:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788463402.792644:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408144000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463402.793507:0:14863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788463402.793603:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788463402.793621:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463402.793635:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463402.793658:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463403.238196:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788463403.819745:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788463404.264313:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463405.285322:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463406.310345:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463407.143831:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463407.143848:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463407.143851:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463407.143854:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463407.143895:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463407.143917:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408144128:0@lo:400:kworker.0 00000100:00100000:0.0:1788463407.144000:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463407.144054:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408144256:0@lo:400:kworker.0 00000100:00100000:0.0:1788463407.144083:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463407.144123:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408144128 00000100:00100000:0.0:1788463407.144132:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408144128 00000100:00100000:0.0:1788463407.144184:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463407.144194:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+12:3276:x1875339408144128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463407.144248:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+12:3276:x1875339408144128:12345-0@lo:400:kworker.0 Request processed in 55us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463407.144255:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463407.144298:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408144256 00000100:00100000:0.0:1788463407.144301:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408144256 00000100:00100000:0.0:1788463407.144329:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463407.144347:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408144256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463407.144399:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8592d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408144256:12345-0@lo:400:kworker.0 Request processed in 64us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463407.144407:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788463407.144784:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ba5e8591180 x1875339408144256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463407.144800:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8591180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408144256:0@lo:400:kworker.0 00000100:00100000:0.0:1788463407.144828:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408144128:0@lo:400:kworker.0 00010000:00010000:2.0:1788463407.332856:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788463407.591564:0:15052:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788463407.591570:0:15052:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788463407.596496:0:15052:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ba5caabb000 00000020:01000004:2.0:1788463407.596523:0:15052:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788463407.596538:0:15052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788463407.596555:0:15052:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ba5c7d7cd40) 00000020:00000080:2.0:1788463407.596571:0:15052:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788463407.630500:0:15052:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788463407.630997:0:15052:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788463407.632124:0:15052:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788463407.632359:0:15052:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788463407.633558:0:15052:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788463407.636220:0:15052:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 581: rc = 0 00100000:10000000:0.0:1788463407.636339:0:15052:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 581: rc = 0 00100000:10000000:0.0:1788463407.636431:0:15052:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 581: rc = 0 00100000:10000000:0.0:1788463407.640106:0:15052:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 447: rc = 0 00100000:10000000:0.0:1788463407.640431:0:15052:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 447: rc = 0 00100000:10000000:0.0:1788463407.640857:0:15052:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 447: rc = 0 00100000:10000000:0.0:1788463407.642887:0:15052:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 447: rc = 0 00100000:10000000:0.0:1788463407.643211:0:15052:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 447: rc = 0 00100000:10000000:0.0:1788463407.643458:0:15052:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 447: rc = 0 00000020:00000080:2.0:1788463407.654266:0:15052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788463407.654280:0:15052:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788463407.654291:0:15052:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3fe72277ee36aa6 00000020:01000004:2.0:1788463407.654300:0:15052:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788463407.654322:0:15052:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788463407.654332:0:15052:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788463407.654340:0:15052:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788463407.654345:0:15052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788463407.654359:0:15052:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ba5c7d78000) 00000020:00000080:2.0:1788463407.654372:0:15052:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788463407.657471:0:15052:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463407.657901:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463407.657910:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788463407.669310:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788463407.669325:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788463407.679776:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788463407.679803:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788463407.691675:0:15052:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788463407.691982:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788463407.691989:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788463407.693262:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788463407.693273:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788463407.759246:0:15052:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788463407.760138:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788463407.760150:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788463407.763797:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788463407.763829:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788463407.765085:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788463407.765097:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788463407.767433:0:15052:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788463407.769510:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788463407.769797:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788463407.770380:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788463407.770392:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788463407.805490:0:15052:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788463407.805955:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788463407.805963:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788463407.807092:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788463407.807102:0:15052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788463407.807903:0:15052:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788463407.807938:0:15052:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788463407.807953:0:15052:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788463407.817968:0:15052:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788463407.818022:0:15052:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.111@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788463407.818027:0:15052:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788463407.818029:0:15052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788463407.818031:0:15052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463407.818032:0:15052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463407.818033:0:15052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463407.818034:0:15052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463407.818036:0:15052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463407.818037:0:15052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463407.818039:0:15052:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788463407.818044:0:15052:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788463407.818046:0:15052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788463407.818048:0:15052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788463407.818049:0:15052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463407.818050:0:15052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463407.818051:0:15052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463407.818052:0:15052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463407.818053:0:15052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463407.818054:0:15052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463407.818055:0:15052:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788463407.818087:0:15052:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788463407.818111:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408144384:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788463407.818223:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463407.818325:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cff840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463407.818373:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408144384 00000100:00100000:2.0:1788463407.818381:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408144384 00000100:00100000:2.0:1788463407.818489:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788463407.818501:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:15052:x1875339408144384:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788463407.818629:0:14361:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788463407.818633:0:14361:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788463407.818637:0:14361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788463407.832673:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:15052:x1875339408144384:12345-0@lo:253:mount.lustre.0 Request processed in 14163us (14440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463407.832711:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788463407.832858:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408144384:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788463407.832875:0:15052:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788463407.832878:0:15052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788463407.832880:0:15052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788463407.832882:0:15052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788463407.832883:0:15052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788463407.832884:0:15052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788463407.832885:0:15052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788463407.832886:0:15052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788463407.832888:0:15052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788463407.832919:0:15052:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788463407.832945:0:15052:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ba5caabb000 from lustre-OST0000 10000000:01000000:1.0:1788463407.832976:0:15052:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788463407.832979:0:15052:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788463407.832987:0:15052:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ba4c54ab380 local copy 00010000:00010000:1.0:1788463407.832999:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369a3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463407.833237:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408144512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463407.833280:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463407.833321:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cfff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463407.833452:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408144512 00000100:00100000:0.0:1788463407.833461:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408144512 00000100:00100000:0.0:1788463407.833533:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463407.833544:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:15052:x1875339408144512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463407.833731:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+12:15052:x1875339408144512:12345-0@lo:501:mount.lustre.0 Request processed in 189us (450us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788463407.833740:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788463407.834399:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408144512:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788463407.834418:0:15052:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788463407.834775:0:15052:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788463407.834783:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369a3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463407.834794:0:15052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369a3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463407.834818:0:15052:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ba5caabb000 10000000:01000000:1.0:1788463407.834893:0:15052:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788463407.834899:0:15052:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ba4c54ab380 10000000:01000000:1.0:1788463407.834903:0:15052:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788463407.834906:0:15052:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ba4c54ab380 from 1 10000000:01000000:1.0:1788463407.834909:0:15052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788463407.834944:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7a00/0xc3fe72277ee36ab4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463407.834951:0:15052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7a00/0xc3fe72277ee36ab4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463407.834968:0:15052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7a00/0xc3fe72277ee36ab4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463407.834983:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408144640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463407.835026:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463407.835101:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cfff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463407.838149:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408144640 00000100:00100000:2.0:1788463407.838170:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408144640 00000100:00100000:2.0:1788463407.838340:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788463407.838356:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+12:15052:x1875339408144640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463407.838382:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463407.838417:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5f7d39000/0xc3fe72277ee36abb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36ab4 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.838504:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5f7d39000/0xc3fe72277ee36abb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36ab4 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.838526:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5f7d39000/0xc3fe72277ee36abb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36ab4 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.838540:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39000, rc 0) 00000100:00100000:2.0:1788463407.838652:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+13:15052:x1875339408144640:12345-0@lo:101:mount.lustre.0 Request processed in 301us (3625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463407.838660:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788463407.839422:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408144640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463407.839452:0:15052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7a00/0xc3fe72277ee36ab4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36abb expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463407.839464:0:15052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7a00/0xc3fe72277ee36ab4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36abb expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463407.839501:0:15052:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788463407.839517:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7a00/0xc3fe72277ee36ab4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36abb expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463407.839527:0:15052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7a00/0xc3fe72277ee36ab4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36abb expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788463407.839538:0:15052:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788463407.839545:0:15052:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788463407.839554:0:15052:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788463407.839558:0:15052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788463407.839593:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7400/0xc3fe72277ee36ac2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463407.839602:0:15052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7400/0xc3fe72277ee36ac2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463407.839628:0:15052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7400/0xc3fe72277ee36ac2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463407.839652:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408144768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788463407.839736:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463407.844432:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408144768 00000100:00100000:3.0:1788463407.844452:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408144768 00000100:00100000:0.0:1788463407.844535:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788463407.844553:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+13:15052:x1875339408144768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463407.844572:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463407.844592:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5e710f200/0xc3fe72277ee36ac9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36ac2 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463407.844624:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5e710f200/0xc3fe72277ee36ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36ac2 expref: 14 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463407.844636:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5e710f200/0xc3fe72277ee36ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36ac2 expref: 14 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463407.844649:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5e710f200, rc 0) 00000100:00100000:0.0:1788463407.844747:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+14:15052:x1875339408144768:12345-0@lo:101:mount.lustre.0 Request processed in 200us (5009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463407.844754:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788463407.845047:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cfff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788463407.845075:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408144768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463407.845094:0:15052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7400/0xc3fe72277ee36ac2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36ac9 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463407.845104:0:15052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7400/0xc3fe72277ee36ac2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36ac9 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788463407.846247:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788463407.848268:0:15052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788463407.848853:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788463407.848909:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788463407.848945:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788463407.848993:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788463407.849029:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788463407.849060:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788463407.849130:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788463407.849138:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788463407.849244:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408144896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463407.849312:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463407.851456:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cffcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463407.854641:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408144896 00000100:00100000:0.0:1788463407.854659:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408144896 00000100:00100000:0.0:1788463407.854767:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788463407.854779:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+14:15052:x1875339408144896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463407.855297:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+14:15052:x1875339408144896:12345-0@lo:501:mount.lustre.0 Request processed in 519us (5984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463407.855305:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788463407.855407:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408144896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463407.855497:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463407.855632:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463407.855766:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cffcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463407.857189:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408145024 00000100:00100000:2.0:1788463407.857205:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408145024 00000100:00100000:3.0:1788463407.857376:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788463407.857390:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+14:15052:x1875339408145024:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463407.857978:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+14:15052:x1875339408145024:12345-0@lo:503:mount.lustre.0 Request processed in 590us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463407.857987:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788463407.858017:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788463407.859943:0:15052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788463407.860035:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463407.860120:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463407.861021:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec1483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463407.861097:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408145152 00000100:00100000:2.0:1788463407.861107:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408145152 00000100:00100000:2.0:1788463407.861211:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788463407.861224:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+14:15052:x1875339408145152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463407.861629:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+14:15052:x1875339408145152:12345-0@lo:502:mount.lustre.0 Request processed in 407us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463407.861637:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788463407.861904:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463407.862175:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788463407.862227:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788463407.862252:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788463407.862299:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788463407.862330:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788463407.862358:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788463407.862400:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788463407.862435:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788463407.862467:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788463407.862708:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788463407.862759:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788463407.862809:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788463407.862852:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463407.862914:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463407.863154:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cff6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463407.863254:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408145280 00000100:00100000:3.0:1788463407.863264:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408145280 00000100:00100000:3.0:1788463407.863308:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788463407.863317:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+14:15052:x1875339408145280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463407.863802:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+14:15052:x1875339408145280:12345-0@lo:502:mount.lustre.0 Request processed in 484us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463407.863810:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788463407.864002:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463407.864100:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788463407.864112:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788463407.865787:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788463407.865803:0:15066:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788463407.865811:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788463407.865813:0:15066:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788463407.865819:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788463407.865838:0:15066:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ba5c7d799c0) 00000020:00000080:2.0:1788463407.865864:0:15066:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788463407.865870:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788463407.865961:0:15066:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba5caabb000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788463407.865977:0:15066:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788463407.865985:0:15066:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3fe72277ee36ad7 00010000:00010000:3.0:1788463407.873257:0:15066:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788463407.873744:0:15066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788463407.877117:0:15066:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788463407.880025:0:15066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788463407.880039:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463407.880046:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463407.880048:0:15066:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788463407.880051:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788463407.880054:0:15066:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788463407.880056:0:15066:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788463407.880057:0:15066:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788463407.880059:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788463407.880061:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463407.880063:0:15066:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788463407.880075:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463407.880079:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463407.880080:0:15066:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788463407.880083:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788463407.880085:0:15066:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788463407.880087:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463407.880089:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463407.880090:0:15066:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788463407.880092:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463407.880094:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463407.880095:0:15066:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788463407.880098:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788463407.880173:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463407.880177:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463407.880178:0:15066:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788463407.880182:0:15066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788463407.880373:0:15052:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788463407.880401:0:15052:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788463407.880463:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7400/0xc3fe72277ee36ac2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36ac9 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.880492:0:15052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7400/0xc3fe72277ee36ac2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36ac9 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463407.880503:0:15052:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5caabb000 from 1 10000000:01000000:2.0:1788463407.880506:0:15052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463407.880569:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.880578:0:15052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.880589:0:15052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463407.880619:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463407.880730:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.880788:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463407.881262:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408145408 00000100:00100000:3.0:1788463407.881272:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408145408 00000100:00100000:3.0:1788463407.881314:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788463407.881323:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+14:15052:x1875339408145408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463407.881341:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463407.881355:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee36ae5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36ade expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463407.881381:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee36ae5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36ade expref: 15 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463407.881393:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee36ae5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36ade expref: 15 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463407.881403:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0c00, rc 0) 00000100:00100000:3.0:1788463407.881450:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408145408:12345-0@lo:101:mount.lustre.0 Request processed in 127us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463407.881485:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788463407.882902:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463407.882934:0:15052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.882945:0:15052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463407.884802:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788463407.885520:0:15052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463407.890355:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788463407.890416:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788463407.891255:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788463407.891350:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788463407.891494:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463407.891831:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463407.891879:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8ef00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463407.891943:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408145536 00000100:00100000:0.0:1788463407.891954:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408145536 00000100:00100000:0.0:1788463407.892010:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788463407.892018:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408145536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463407.892286:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408145536:12345-0@lo:501:mount.lustre.0 Request processed in 267us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463407.892295:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788463407.892401:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463407.892458:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463407.892517:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.892547:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee300 going to sleep for 11 seconds 00000100:00100000:3.0:1788463407.892762:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408145664 00000100:00100000:3.0:1788463407.892767:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408145664 00000100:00100000:3.0:1788463407.892807:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788463407.892814:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408145664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463407.892983:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408145664:12345-0@lo:503:mount.lustre.0 Request processed in 168us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463407.892990:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788463407.893176:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145664:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788463407.894263:0:15052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463407.894382:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145792:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463407.894446:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.895174:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463407.899727:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408145792 00000100:00100000:0.0:1788463407.899749:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408145792 00000100:00100000:0.0:1788463407.899818:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788463407.899831:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408145792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463407.900138:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408145792:12345-0@lo:502:mount.lustre.0 Request processed in 310us (5691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463407.900147:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788463407.901004:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145792:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463407.901330:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788463407.901384:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788463407.901442:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788463407.901777:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788463407.901814:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788463407.901879:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788463407.901915:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788463407.901942:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788463407.901980:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145920:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463407.902044:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.902081:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1788463407.902173:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408145920 00000100:00100000:0.0:1788463407.902180:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408145920 00000100:00100000:0.0:1788463407.902237:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788463407.902248:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408145920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463407.904703:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408145920:12345-0@lo:502:mount.lustre.0 Request processed in 2434us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463407.904722:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788463407.904969:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408145920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788463407.905161:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788463407.905181:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788463407.906918:0:15070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463407.906933:0:15070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463407.906936:0:15070:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788463407.906942:0:15070:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba5caabb000 00000020:00000080:0.0:1788463407.906945:0:15070:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463407.906955:0:15070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463407.906957:0:15070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463407.906958:0:15070:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788463407.906960:0:15070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463407.906962:0:15070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463407.906964:0:15070:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788463407.906968:0:15070:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba5caabb000 00000020:00000080:0.0:1788463407.906970:0:15070:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463407.907035:0:15070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463407.907039:0:15070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463407.907040:0:15070:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788463407.907042:0:15070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463407.907044:0:15070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463407.907046:0:15070:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788463407.907049:0:15070:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ba5caabb000 00000020:00000080:0.0:1788463407.907052:0:15070:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463407.907088:0:15070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463407.907092:0:15070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463407.907093:0:15070:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788463407.907096:0:15070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788463407.921041:0:15052:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788463407.921094:0:15052:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463407.921139:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.921153:0:15052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463407.921246:0:15052:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788463407.921249:0:15052:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ba5caabb000 10000000:01000000:2.0:1788463407.921252:0:15052:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ba5caabb000 10000000:01000000:2.0:1788463407.921256:0:15052:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463407.921263:0:15052:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba5caabb000 from 1 10000000:01000000:2.0:1788463407.921266:0:15052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463407.921302:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38e00/0xc3fe72277ee36aec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.921311:0:15052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38e00/0xc3fe72277ee36aec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.921321:0:15052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38e00/0xc3fe72277ee36aec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463407.921345:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463407.921422:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.921968:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408146048 00000100:00100000:2.0:1788463407.921977:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408146048 00000100:00100000:2.0:1788463407.922027:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788463407.922036:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408146048:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463407.922050:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463407.922066:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5f7d39e00/0xc3fe72277ee36af3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36aec expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.922106:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5f7d39e00/0xc3fe72277ee36af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36aec expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.922117:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5f7d39e00/0xc3fe72277ee36af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36aec expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.922127:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39e00, rc 0) 00000100:00100000:2.0:1788463407.922175:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+16:15052:x1875339408146048:12345-0@lo:101:mount.lustre.0 Request processed in 141us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463407.922182:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788463407.922232:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee000 going to sleep for 11 seconds 00000100:00100000:2.0:1788463407.922255:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463407.922271:0:15052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38e00/0xc3fe72277ee36aec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36af3 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.922281:0:15052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38e00/0xc3fe72277ee36aec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36af3 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463407.923269:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788463407.930364:0:15052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463407.933119:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788463407.933197:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788463407.934788:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788463407.934902:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788463407.934943:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788463407.934997:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788463407.935034:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788463407.935069:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788463407.935135:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788463407.935169:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788463407.935226:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788463407.935293:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788463407.935326:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788463407.935354:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788463407.935392:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788463407.935420:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788463407.935445:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788463407.935499:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788463407.937803:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788463407.937877:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788463407.937946:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788463407.937985:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788463407.938020:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788463407.938068:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788463407.938105:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788463407.938141:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788463407.938213:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788463407.938252:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788463407.938347:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788463407.938356:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788463407.938485:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463407.939125:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.940336:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee000 going to sleep for 11 seconds 00000100:00100000:3.0:1788463407.943191:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408146176 00000100:00100000:3.0:1788463407.943209:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408146176 00000100:00100000:3.0:1788463407.943283:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788463407.943296:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+16:15052:x1875339408146176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463407.945874:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+16:15052:x1875339408146176:12345-0@lo:501:mount.lustre.0 Request processed in 2573us (6741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463407.945888:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788463407.946124:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463407.946178:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788463407.946233:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.946266:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee000 going to sleep for 11 seconds 00000100:00100000:3.0:1788463407.946788:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408146304 00000100:00100000:3.0:1788463407.946797:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408146304 00000100:00100000:3.0:1788463407.946857:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788463407.946869:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+16:15052:x1875339408146304:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463407.947103:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+16:15052:x1875339408146304:12345-0@lo:503:mount.lustre.0 Request processed in 236us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463407.947111:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788463407.947212:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146304:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788463407.948013:0:15052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788463407.948095:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463407.948154:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.948184:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee000 going to sleep for 11 seconds 00000100:00100000:3.0:1788463407.948754:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408146432 00000100:00100000:3.0:1788463407.948764:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408146432 00000100:00100000:3.0:1788463407.948825:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788463407.948837:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+16:15052:x1875339408146432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463407.949117:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+16:15052:x1875339408146432:12345-0@lo:502:mount.lustre.0 Request processed in 280us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463407.949125:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788463407.949720:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463407.950078:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788463407.950141:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788463407.950178:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788463407.950222:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788463407.950258:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788463407.950302:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788463407.950339:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788463407.950369:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788463407.950416:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788463407.950454:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788463407.952928:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788463407.953035:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788463407.953077:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788463407.953117:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788463407.953172:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788463407.953214:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788463407.953273:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788463407.953326:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788463407.953363:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788463407.953396:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788463407.953443:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788463407.953494:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788463407.955004:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788463407.955123:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788463407.955163:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788463407.955198:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788463407.955242:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788463407.955273:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788463407.955303:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788463407.955387:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788463407.955427:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788463407.955463:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788463407.956987:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788463407.957098:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788463407.957139:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788463407.957193:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788463407.957231:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788463407.957266:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788463407.957314:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788463407.957351:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788463407.957407:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463407.958005:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463407.958052:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8ef0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788463407.959513:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408146560 00000100:00100000:2.0:1788463407.959542:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408146560 00000100:00100000:2.0:1788463407.959628:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788463407.959641:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+16:15052:x1875339408146560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463407.959989:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+16:15052:x1875339408146560:12345-0@lo:502:mount.lustre.0 Request processed in 350us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463407.959998:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788463407.960205:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463407.960332:0:15052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788463407.960349:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788463407.965140:0:15075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788463407.965162:0:15075:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ba4c5194d40) 00000020:00000080:3.0:1788463407.965185:0:15075:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788463407.965284:0:15075:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba5caabb000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788463407.965289:0:15075:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ba5caabb000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788463407.965292:0:15075:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba5caabb000 3 00010000:00080000:3.0:1788463407.965325:0:15075:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ba5f7f73800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.111@tcp at head 00010000:00010000:2.0:1788463407.984405:0:15075:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788463407.984669:0:15075:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788463407.984725:0:15075:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788463407.984740:0:15075:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc3fe72277ee36b01 00000100:00080000:2.0:1788463407.984751:0:15075:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788463407.984759:0:15075:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ba5f7f73800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:2.0:1788463407.984810:0:15075:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5c328dc00 x1875339408146688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788463407.984834:0:15075:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788463407.984864:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463407.984869:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788463407.984871:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788463407.984874:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788463407.984925:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408146816:0@lo:400:kworker.0 00000100:00100000:2.0:1788463407.984990:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.985042:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408146816 00000100:00100000:2.0:1788463407.985048:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408146816 00000100:00100000:2.0:1788463407.985089:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463407.985099:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408146816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463407.985149:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408146816:12345-0@lo:400:kworker.0 Request processed in 51us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463407.985156:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788463407.985194:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ba5c328df80 x1875339408146816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463407.985207:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408146816:0@lo:400:kworker.0 00000100:00100000:0.0:1788463407.986110:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875339408146688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788463407.986156:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.986318:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408146688 00000100:00100000:2.0:1788463407.986325:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408146688 00000100:00100000:2.0:1788463407.986359:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463407.986365:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3275:x1875339408146688:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788463407.986393:0:14369:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:2.0:1788463407.986440:0:14369:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc3fe72277ee36b08 00000004:00100000:2.0:1788463407.986459:0:14369:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788463407.986515:0:14369:0:(import.c:65:import_set_state_nolock()) ffff9ba5ebddc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463407.986573:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875339408146688:12345-0@lo:38:llog_process_th.0 Request processed in 207us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463407.986581:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788463407.986728:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ba5c328dc00 x1875339408146688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463407.986743:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463407.986750:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788463407.986757:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788463407.986762:0:3275:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788463407.986764:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5f7f73800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788463407.986770:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3275:1875339408146688:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788463407.987973:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788463407.988255:0:15052:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788463407.988278:0:15052:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788463407.988302:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38e00/0xc3fe72277ee36aec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36af3 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463407.988313:0:15052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38e00/0xc3fe72277ee36aec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36af3 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788463407.988362:0:15052:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788463407.988364:0:15052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788463407.988365:0:15052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463407.988367:0:15052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463407.988368:0:15052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463407.988369:0:15052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463407.988371:0:15052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463407.988372:0:15052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463407.988374:0:15052:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788463407.988378:0:15052:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788463407.988381:0:15052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463407.988382:0:15052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788463407.988383:0:15052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463407.988384:0:15052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463407.988386:0:15052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463407.988387:0:15052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463407.988387:0:15052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463407.988388:0:15052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463407.988389:0:15052:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788463407.988433:0:15052:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788463407.988457:0:15052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146944:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788463407.988771:0:15052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463407.988819:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408146944 00000100:00100000:2.0:1788463407.988827:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408146944 00000100:00100000:2.0:1788463407.988874:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463407.988884:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5cab49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+16:15052:x1875339408146944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788463407.988934:0:14362:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788463407.988950:0:14362:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788463407.993226:0:15052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29ee840 going to sleep for 11 seconds 20000000:01000000:3.0:1788463408.041215:0:14362:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788463408.041266:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788463408.044033:0:14384:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788463408.044042:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788463408.044065:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463408.044083:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5e710f000/0xc3fe72277ee36a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36a75 expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463408.044093:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463408.044138:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5e710f000/0xc3fe72277ee36a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee36a75 expref: 16 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463408.044153:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba5e710f000/0xc3fe72277ee36a7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee36a75 expref: 16 pid: 14362 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463408.044167:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1875339408147072:0@lo:104: 00000100:00100000:2.0:1788463408.044236:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463408.044321:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec39b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788463408.053376:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408147072 00000100:00100000:0.0:1788463408.053395:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408147072 00000100:00100000:0.0:1788463408.053485:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463408.053498:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b647fa9f-8776-4850-826f-89ba9b699661+3:14384:x1875339408147072:12345-0@lo:104: 00010000:00010000:0.0:1788463408.053767:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463408.053900:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463408.053907:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b647fa9f-8776-4850-826f-89ba9b699661+3:14384:x1875339408147072:12345-0@lo:104: Request processed in 413us (9671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463408.053915:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788463408.056181:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463408.056200:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.056238:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6400 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1788463408.056243:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.056253:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463408.056261:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463408.056267:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463408.056349:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.056356:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463408.056377:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.056384:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf6400/0xc3fe72277ee36a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a7c expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.056407:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463408.056409:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463408.056410:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463408.056555:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463408.056582:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b647fa9f-8776-4850-826f-89ba9b699661:3277:1875339408147200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788463408.056651:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463408.056768:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1875339408147072:0@lo:104: 00010000:00010000:2.0:1788463408.056790:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463408.058492:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408147200 00000100:00100000:3.0:1788463408.058506:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408147200 00010000:00010000:3.0:1788463408.058554:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5e710f000/0xc3fe72277ee36a7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36a75 expref: 17 pid: 14362 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463408.058585:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463408.058605:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+17:3277:x1875339408147200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463408.058620:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463408.058626:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5e710f000/0xc3fe72277ee36a7c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36a75 expref: 17 pid: 14362 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058637:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5e710f000/0xc3fe72277ee36a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee36a75 expref: 17 pid: 14362 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058654:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5e710f000/0xc3fe72277ee36a7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee36a75 expref: 17 pid: 14362 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058671:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058681:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788463408.058714:0:14353:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014673697s 00010000:00010000:3.0:1788463408.058719:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058727:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058735:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058742:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058748:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39c00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463408.058757:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058767:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058780:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463408.058791:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463408.058853:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+16:3277:x1875339408147200:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463408.058861:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788463408.059026:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b647fa9f-8776-4850-826f-89ba9b699661:3277:1875339408147200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788463408.059056:0:14384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463408.059064:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463408.059070:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5f7d39c00/0xc3fe72277ee36b0f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463408.074198:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5cab49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+15:15052:x1875339408146944:12345-0@lo:253:mount.lustre.0 Request processed in 85306us (85419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463408.074230:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788463408.074348:0:15052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15052:1875339408146944:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463408.074366:0:15052:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788463408.074370:0:15052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463408.074372:0:15052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788463408.074373:0:15052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463408.074375:0:15052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463408.074376:0:15052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463408.074378:0:15052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463408.074379:0:15052:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463408.074381:0:15052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463408.074382:0:15052:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788463408.074399:0:15052:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788463408.085972:0:15052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463408.086161:0:15052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788463408.086330:0:15052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463408.086512:0:15052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788463408.086711:0:15052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788463408.087034:0:15052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788463408.092795:0:15052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788463408.220617:0:15052:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788463408.220626:0:15052:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788463408.220661:0:15052:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788463408.220740:0:15052:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788463408.220759:0:15052:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788463408.220797:0:15052:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788463408.359894:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463409.381831:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788463409.898894:0:14365:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788463409.898903:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ba5ebded800 from 7 10000000:01000000:3.0:1788463409.898909:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463409.898956:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463409.898969:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463409.898981:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463409.899010:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408147328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463409.899097:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463409.899154:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e04859c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463409.900068:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408147328 00000100:00100000:1.0:1788463409.900078:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408147328 00000100:00100000:1.0:1788463409.900153:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788463409.900163:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5cab4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+15:14365:x1875339408147328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463409.900179:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463409.900197:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5efaf6e00/0xc3fe72277ee36b1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36b16 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463409.900224:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5efaf6e00/0xc3fe72277ee36b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36b16 expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463409.900235:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5efaf6e00/0xc3fe72277ee36b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36b16 expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463409.900245:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf6e00, rc 0) 00000100:00100000:1.0:1788463409.900306:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5cab4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+16:14365:x1875339408147328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463409.900312:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788463409.900365:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408147328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463409.900382:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463409.900391:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463409.900462:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408147456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788463409.900502:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463409.900538:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cff540 going to sleep for 11 seconds 00000100:00100000:1.0:1788463409.900556:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408147456 00000100:00100000:1.0:1788463409.900560:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408147456 00000100:00100000:1.0:1788463409.900589:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788463409.900596:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5cab49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+16:14365:x1875339408147456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788463409.900610:0:14362:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788463409.900625:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788463409.901176:0:14362:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788463409.901276:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5cab49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+16:14365:x1875339408147456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 680us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463409.901286:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788463409.901922:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408147456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788463409.902009:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788463409.902020:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463409.902031:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463410.404986:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463411.428894:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463412.452907:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463413.093485:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1788463413.286790:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463413.286798:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788463413.286801:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463413.286804:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788463413.286879:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463413.286902:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408147584:0@lo:400:kworker.0 00000100:00100000:0.0:1788463413.286982:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463413.287044:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408147712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463413.287076:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463413.287099:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463413.287104:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408147840:0@lo:400:kworker.0 00000100:00100000:0.0:1788463413.287126:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463413.287160:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408147584 00000100:00100000:0.0:1788463413.287169:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408147584 00000100:00100000:0.0:1788463413.287216:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788463413.287226:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+16:3276:x1875339408147584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463413.287274:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+16:3276:x1875339408147584:12345-0@lo:400:kworker.0 Request processed in 50us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463413.287281:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788463413.287314:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408147712 00000100:00100000:0.0:1788463413.287318:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408147712 00000100:00100000:0.0:1788463413.287340:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408147840 00000100:00100000:0.0:1788463413.287342:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408147840 00000100:00100000:0.0:1788463413.287518:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463413.287526:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408147712:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788463413.287747:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463413.287890:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408147712:12345-0@lo:400:kworker.0 Request processed in 40us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463413.287897:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463413.287911:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463413.287919:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408147840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463413.287952:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408147840:12345-0@lo:400:kworker.0 Request processed in 35us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463413.287959:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788463413.290437:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5e8590e00 x1875339408147840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463413.290459:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408147840:0@lo:400:kworker.0 00010000:00080000:0.0:1788463413.290474:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5e8593480 x1875339408147712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463413.290483:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408147712:0@lo:400:kworker.0 00000100:00100000:0.0:1788463413.290529:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408147584:0@lo:400:kworker.0 00010000:00010000:0.0:1788463413.477099:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463414.504418:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463415.524923:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463416.551899:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788463416.814167:0:15423:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788463417.196103:0:3275:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463402/real 1788463402] req@ffff9ba5c328f480 x1875339408143360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463417.196138:0:3275:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ba5c328f480 x1875339408143360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463417.196173:0:3275:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788463402/real 1788463402] req@ffff9ba5c328ce00 x1875339408143488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463417.196184:0:3275:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ba5c328ce00 x1875339408143488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788463417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788463417.196205:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5efad4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463417.196232:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788463417.196236:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408143360:0@lo:8:kworker.0 00000100:00080000:0.0:1788463417.196242:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463417.196246:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788463417.196249:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408143488:0@lo:8:kworker.0 00000100:00080000:0.0:1788463417.196339:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463417.196343:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788463417.196346:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ba5efad4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463417.196351:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:0.0:1788463417.196368:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788463417.196376:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ba5efad4000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463417.196401:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5e8593480 x1875339408148096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788463417.196414:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463417.196417:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463417.196418:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463417.196421:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:0.0:1788463417.196424:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788463417.196445:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ba5c7de7800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463417.196457:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5e8590e00 x1875339408148224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463417.196506:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408147968:0@lo:400:kworker.0 00000100:00100000:0.0:1788463417.196577:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463417.196621:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463417.196626:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408148352:0@lo:400:kworker.0 00000100:00100000:0.0:1788463417.196650:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463417.196680:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408148480:0@lo:400:kworker.0 00000100:00100000:0.0:1788463417.196724:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463417.196756:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408147968 00000100:00100000:0.0:1788463417.196766:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408147968 00000100:00100000:0.0:1788463417.196811:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463417.196819:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+16:3276:x1875339408147968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463417.196861:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+16:3276:x1875339408147968:12345-0@lo:400:kworker.0 Request processed in 43us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463417.196868:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788463417.196895:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408148352 00000100:00100000:0.0:1788463417.196898:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408148352 00000100:00100000:0.0:1788463417.196916:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408148480 00000100:00100000:0.0:1788463417.196918:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408148480 00000100:00100000:0.0:1788463417.196939:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463417.196944:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408148352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463417.196970:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408148352:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463417.196976:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463417.196993:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463417.196999:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408148480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463417.197028:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408148480:12345-0@lo:400:kworker.0 Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463417.197034:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788463417.197056:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788463417.197075:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5e8590700 x1875339408148480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463417.197087:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408148480:0@lo:400:kworker.0 00010000:00080000:0.0:1788463417.197104:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5e8591880 x1875339408148352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463417.197111:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8591880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408148352:0@lo:400:kworker.0 00000100:00100000:0.0:1788463417.197118:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8592300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408147968:0@lo:400:kworker.0 00000100:00100000:0.0:1788463417.197132:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408148096:0@lo:8:kworker.0 00000100:00100000:0.0:1788463417.197158:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463417.197183:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408148224:0@lo:8:kworker.0 00000100:00100000:0.0:1788463417.197202:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463417.197831:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408148096 00000100:00100000:1.0:1788463417.197840:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408148096 00000100:00100000:1.0:1788463417.197868:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408148224 00000100:00100000:1.0:1788463417.197870:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408148224 00000100:00100000:1.0:1788463417.197882:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463417.197888:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3275:x1875339408148096:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788463417.197918:0:15053:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1788463417.197956:0:15053:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3fe72277ee36b24 00002000:00100000:1.0:1788463417.197973:0:15053:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ba5ebff9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788463417.197977:0:15053:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788463417.197980:0:15053:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788463417.204739:0:15053:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788463417.204791:0:15053:0:(import.c:65:import_set_state_nolock()) ffff9ba5ebff9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463417.204895:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8592300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3275:x1875339408148096:12345-0@lo:8:kworker.0 Request processed in 7004us (7733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463417.204906:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463417.204938:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788463417.204946:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3275:x1875339408148224:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788463417.204962:0:15053:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788463417.208443:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5e8593480 x1875339408148096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463417.208458:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788463417.208470:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788463417.208479:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788463417.208485:0:3275:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788463417.208489:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5efad4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788463417.208539:0:3275:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788463417.208547:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408148096:0@lo:8:kworker.0 00000004:00080000:0.0:1788463417.208628:0:14391:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788463417.208655:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1875339408148736:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788463417.208776:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463417.208808:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7cb8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788463417.208834:0:15056:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463417.208840:0:15056:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788463417.208949:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408148608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463417.208973:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463417.209027:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408148736 00000100:00100000:0.0:1788463417.209033:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408148736 00000100:00080000:0.0:1788463417.209077:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463417.209145:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463417.209156:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14391:x1875339408148736:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788463417.211400:0:14390:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788463417.211856:0:14390:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 448822170620ns, next at 0ns, rc = 0 00002000:00080000:0.0:1788463417.244037:0:15438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788463417.244057:0:15438:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788463417.244064:0:15438:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:1.0:1788463417.271556:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408148608 00000100:00100000:1.0:1788463417.271571:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408148608 00000100:00100000:1.0:1788463417.271636:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463417.271647:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408148608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463417.272578:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463417.272720:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8593100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3279:x1875339408148608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1072us (63742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463417.272731:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788463417.272829:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3275:x1875339408148224:12345-0@lo:8:kworker.0 Request processed in 67884us (75626us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788463417.272838:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788463417.275511:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5e8593480 x1875339408148608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463417.275544:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408148608:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788463417.275592:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788463417.275598:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788463417.275601:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408148224:0@lo:8:kworker.0 00002000:00010000:0.0:1788463417.295503:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.295516:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36b2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.295539:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.295544:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.295552:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.295571:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.295584:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.295592:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36b2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.295616:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463417.295635:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463417.295648:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36b2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.295657:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710ee00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463417.295662:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36b2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.295671:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36b2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.295722:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36b2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.295730:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36b2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.295753:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.295755:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.295757:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.301405:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.301421:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36b32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.301442:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.301448:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.301456:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.301475:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.301487:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.301496:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.301537:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463417.301554:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463417.301561:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.301569:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463417.301574:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.301583:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.301601:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36b32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.301609:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36b32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.301630:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.301633:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.301634:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.302328:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.302336:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36b39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.302346:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.302355:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.302359:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.302369:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.302377:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.302384:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.302403:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463417.302414:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463417.302418:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.302426:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463417.302430:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.302437:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36b39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.302448:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36b39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.302465:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36b39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.302480:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.302482:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.302484:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.303225:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.303233:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36b40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.303244:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.303248:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.303253:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.303264:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.303272:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.303279:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.303561:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463417.303576:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463417.303589:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.303597:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463417.303602:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.303612:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36b40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.303629:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36b40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.303636:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36b40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.304111:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.304114:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.304117:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.306741:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.306762:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001815f1cd/0xc3fe72277ee36b47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.306920:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.306926:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.306933:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001815f1cd/0xc3fe72277ee36b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.306963:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001815f1cd/0xc3fe72277ee36b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.306976:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001815f1cd/0xc3fe72277ee36b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.306985:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001815f1cd/0xc3fe72277ee36b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.307012:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463417.307030:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463417.307038:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001815f1cd/0xc3fe72277ee36b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.307046:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463417.307051:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001815f1cd/0xc3fe72277ee36b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.307063:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001815f1cd/0xc3fe72277ee36b47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.307082:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001815f1cd/0xc3fe72277ee36b47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.307090:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001815f1cd/0xc3fe72277ee36b47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.307120:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.307122:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.307124:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.309276:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.309299:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef80c070/0xc3fe72277ee36b4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.309318:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.309324:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.309332:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef80c070/0xc3fe72277ee36b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.309350:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef80c070/0xc3fe72277ee36b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.309362:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef80c070/0xc3fe72277ee36b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.309372:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef80c070/0xc3fe72277ee36b4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.309394:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463417.309409:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463417.309415:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef80c070/0xc3fe72277ee36b4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.309436:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710fa00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463417.309443:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef80c070/0xc3fe72277ee36b4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.309453:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef80c070/0xc3fe72277ee36b4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.309471:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef80c070/0xc3fe72277ee36b4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.309479:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef80c070/0xc3fe72277ee36b4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.309504:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.309506:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.309508:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.310473:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.310482:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edd24508/0xc3fe72277ee36b55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.310493:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.310497:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.310502:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edd24508/0xc3fe72277ee36b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.310513:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edd24508/0xc3fe72277ee36b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.310531:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edd24508/0xc3fe72277ee36b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.310538:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edd24508/0xc3fe72277ee36b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.310558:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463417.310570:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463417.310575:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edd24508/0xc3fe72277ee36b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.310583:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030c00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463417.310587:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edd24508/0xc3fe72277ee36b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.310596:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edd24508/0xc3fe72277ee36b55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.310614:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edd24508/0xc3fe72277ee36b55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.310621:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edd24508/0xc3fe72277ee36b55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.310744:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.310755:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.310757:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.311395:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.311403:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ef6831b/0xc3fe72277ee36b5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.311413:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.311416:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.311420:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ef6831b/0xc3fe72277ee36b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.311431:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ef6831b/0xc3fe72277ee36b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.311438:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ef6831b/0xc3fe72277ee36b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.311446:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ef6831b/0xc3fe72277ee36b5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.311465:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463417.311474:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463417.311479:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ef6831b/0xc3fe72277ee36b5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.311487:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0031800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463417.311491:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ef6831b/0xc3fe72277ee36b5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.311512:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ef6831b/0xc3fe72277ee36b5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.311526:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ef6831b/0xc3fe72277ee36b5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.311534:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ef6831b/0xc3fe72277ee36b5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.311552:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.311553:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.311555:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.319801:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.319814:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8ad3a97/0xc3fe72277ee36b63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.319832:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.319837:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.319844:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8ad3a97/0xc3fe72277ee36b63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.319860:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8ad3a97/0xc3fe72277ee36b63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.319871:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8ad3a97/0xc3fe72277ee36b63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.319888:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8ad3a97/0xc3fe72277ee36b63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.319911:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463417.319927:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463417.319934:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8ad3a97/0xc3fe72277ee36b63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.319942:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463417.319948:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8ad3a97/0xc3fe72277ee36b63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.319957:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8ad3a97/0xc3fe72277ee36b63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.319977:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8ad3a97/0xc3fe72277ee36b63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.319986:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8ad3a97/0xc3fe72277ee36b63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.320606:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.320724:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.320727:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.321417:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.321434:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a158b484/0xc3fe72277ee36b6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.321448:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.321453:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.321459:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a158b484/0xc3fe72277ee36b6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.321476:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a158b484/0xc3fe72277ee36b6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.321486:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a158b484/0xc3fe72277ee36b6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788463417.322098:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788463417.322183:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a158b484/0xc3fe72277ee36b6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.322209:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463417.322236:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463417.322245:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a158b484/0xc3fe72277ee36b6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.322256:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030a00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463417.322261:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a158b484/0xc3fe72277ee36b6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.322298:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a158b484/0xc3fe72277ee36b6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.322323:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a158b484/0xc3fe72277ee36b6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.322333:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a158b484/0xc3fe72277ee36b6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.322532:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463417.322535:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463417.322537:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.323467:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.323475:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd029cfc/0xc3fe72277ee36b71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.323488:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.323559:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.323566:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd029cfc/0xc3fe72277ee36b71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.323579:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd029cfc/0xc3fe72277ee36b71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.323595:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd029cfc/0xc3fe72277ee36b71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.323602:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd029cfc/0xc3fe72277ee36b71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.324086:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463417.325178:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.325189:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cec6c194/0xc3fe72277ee36b78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.325207:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.325211:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.325217:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cec6c194/0xc3fe72277ee36b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.325231:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cec6c194/0xc3fe72277ee36b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.325241:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cec6c194/0xc3fe72277ee36b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.325251:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cec6c194/0xc3fe72277ee36b78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.325333:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788463417.325975:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.325982:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097c617c7/0xc3fe72277ee36b7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.325994:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.325998:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.326002:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097c617c7/0xc3fe72277ee36b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.326011:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097c617c7/0xc3fe72277ee36b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.326020:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097c617c7/0xc3fe72277ee36b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.326026:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097c617c7/0xc3fe72277ee36b7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326362:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788463417.326373:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd029cfc/0xc3fe72277ee36b71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326382:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0031200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.326388:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd029cfc/0xc3fe72277ee36b71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326399:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd029cfc/0xc3fe72277ee36b71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326426:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd029cfc/0xc3fe72277ee36b71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326435:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd029cfc/0xc3fe72277ee36b71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326461:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463417.326464:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cec6c194/0xc3fe72277ee36b78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326485:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0031600 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.326488:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cec6c194/0xc3fe72277ee36b78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326575:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cec6c194/0xc3fe72277ee36b78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326587:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cec6c194/0xc3fe72277ee36b78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326594:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cec6c194/0xc3fe72277ee36b78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326674:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463417.326679:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097c617c7/0xc3fe72277ee36b7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326704:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030e00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.326707:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097c617c7/0xc3fe72277ee36b7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326716:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097c617c7/0xc3fe72277ee36b7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326726:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097c617c7/0xc3fe72277ee36b7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.326741:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.326744:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.326746:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.326971:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788463417.326977:0:15438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097c617c7/0xc3fe72277ee36b7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463417.328282:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.328304:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca06d691/0xc3fe72277ee36b86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.328326:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.328331:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.328337:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca06d691/0xc3fe72277ee36b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.328352:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca06d691/0xc3fe72277ee36b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.328362:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca06d691/0xc3fe72277ee36b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.328369:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca06d691/0xc3fe72277ee36b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.328382:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463417.329051:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.329058:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67c7895/0xc3fe72277ee36b8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.329067:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.329070:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.329074:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b67c7895/0xc3fe72277ee36b8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.329084:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b67c7895/0xc3fe72277ee36b8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.329105:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b67c7895/0xc3fe72277ee36b8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.329113:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b67c7895/0xc3fe72277ee36b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.329122:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788463417.329597:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.329604:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b967cffc/0xc3fe72277ee36b94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.329613:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.329616:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.329621:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b967cffc/0xc3fe72277ee36b94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.329631:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b967cffc/0xc3fe72277ee36b94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.329640:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b967cffc/0xc3fe72277ee36b94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.329649:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b967cffc/0xc3fe72277ee36b94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.329669:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788463417.330296:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.330304:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f77983ec/0xc3fe72277ee36b9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.330314:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.330318:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.330322:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f77983ec/0xc3fe72277ee36b9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.330333:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f77983ec/0xc3fe72277ee36b9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.330342:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f77983ec/0xc3fe72277ee36b9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.330349:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f77983ec/0xc3fe72277ee36b9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.330359:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788463417.330627:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788463417.330637:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca06d691/0xc3fe72277ee36b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330646:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0031e00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.330652:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca06d691/0xc3fe72277ee36b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330661:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca06d691/0xc3fe72277ee36b86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330680:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca06d691/0xc3fe72277ee36b86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.330701:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788463417.330705:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca06d691/0xc3fe72277ee36b86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330733:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463417.330737:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b967cffc/0xc3fe72277ee36b94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330743:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0031a00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.330754:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b967cffc/0xc3fe72277ee36b94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330763:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b967cffc/0xc3fe72277ee36b94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330787:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b967cffc/0xc3fe72277ee36b94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330858:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b967cffc/0xc3fe72277ee36b94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330873:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463417.330877:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f77983ec/0xc3fe72277ee36b9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330884:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0031400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.330887:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f77983ec/0xc3fe72277ee36b9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330896:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f77983ec/0xc3fe72277ee36b9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330907:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f77983ec/0xc3fe72277ee36b9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330915:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f77983ec/0xc3fe72277ee36b9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.330939:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.330942:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.330944:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463417.331145:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463417.331148:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463417.331150:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.331318:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b67c7895/0xc3fe72277ee36b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.331327:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0031000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.331331:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67c7895/0xc3fe72277ee36b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.331340:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b67c7895/0xc3fe72277ee36b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.331351:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b67c7895/0xc3fe72277ee36b8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.331359:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b67c7895/0xc3fe72277ee36b8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.331375:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.331377:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.331379:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.332590:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.332603:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ce5a5e8/0xc3fe72277ee36ba2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.332618:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.332629:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.332636:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ce5a5e8/0xc3fe72277ee36ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.332651:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ce5a5e8/0xc3fe72277ee36ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.332661:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ce5a5e8/0xc3fe72277ee36ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.332668:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ce5a5e8/0xc3fe72277ee36ba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.332703:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463417.332782:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463417.332790:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ce5a5e8/0xc3fe72277ee36ba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.332800:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c0030800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463417.332805:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ce5a5e8/0xc3fe72277ee36ba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.332814:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ce5a5e8/0xc3fe72277ee36ba2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.332841:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ce5a5e8/0xc3fe72277ee36ba2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.332849:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ce5a5e8/0xc3fe72277ee36ba2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.332870:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463417.332872:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463417.332874:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.333360:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.333366:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36ba9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.333374:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.333378:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.333382:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36ba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.333392:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36ba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.333400:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36ba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.333415:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36ba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.333434:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463417.333476:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463417.333482:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36ba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.333491:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710e200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463417.333494:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36ba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.333503:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36ba9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.333514:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36ba9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.333521:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2aa741d/0xc3fe72277ee36ba9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463417.333551:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463417.333553:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463417.333555:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.339204:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.339227:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36bb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.339250:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.339255:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.339263:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36bb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.339282:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36bb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.339314:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36bb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.339324:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36bb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.339386:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463417.340283:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.340301:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36bb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.340318:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.340322:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.340326:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.340338:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.340347:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.340354:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.342032:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463417.342050:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36bb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.342082:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.342089:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36bb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.342102:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36bb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.342130:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36bb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.342140:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000451e3789/0xc3fe72277ee36bb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.342419:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463417.342521:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463417.342529:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.342539:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710f400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463417.342543:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.342551:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36bb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.342567:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36bb7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.342574:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046185fac/0xc3fe72277ee36bb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.342590:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463417.342710:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463417.342712:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463417.342714:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.343925:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.343937:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36bbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.343956:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.343961:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.343969:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36bbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.343985:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36bbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.344008:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36bbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.344015:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36bbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.344044:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463417.344108:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463417.344117:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36bbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.344127:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5e710ee00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463417.344139:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36bbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.344150:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36bbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.344168:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36bbe lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.344176:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb8ee3cc/0xc3fe72277ee36bbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.344338:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463417.344342:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463417.344345:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.344637:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.344643:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027901813/0xc3fe72277ee36bc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.344653:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.344657:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.344662:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027901813/0xc3fe72277ee36bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.344671:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027901813/0xc3fe72277ee36bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.344679:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027901813/0xc3fe72277ee36bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.344708:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027901813/0xc3fe72277ee36bc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.344737:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463417.344900:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463417.344907:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027901813/0xc3fe72277ee36bc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.344915:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47adc00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.344919:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027901813/0xc3fe72277ee36bc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.344928:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027901813/0xc3fe72277ee36bc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.344952:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027901813/0xc3fe72277ee36bc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.344960:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027901813/0xc3fe72277ee36bc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.344975:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.344977:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.344979:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.345554:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.345562:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36bcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.345572:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.345576:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.345580:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36bcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.345591:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36bcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.345599:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36bcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.345607:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36bcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.345631:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463417.345731:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463417.345738:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36bcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.345747:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47ac400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463417.345752:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36bcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.345763:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36bcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.345777:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36bcc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.345793:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36bcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.345813:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463417.345814:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463417.345817:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.346381:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.346387:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008abd6a7c/0xc3fe72277ee36bd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.346396:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.346407:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.346412:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008abd6a7c/0xc3fe72277ee36bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.346423:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008abd6a7c/0xc3fe72277ee36bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.346431:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008abd6a7c/0xc3fe72277ee36bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.346438:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008abd6a7c/0xc3fe72277ee36bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.346461:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463417.346575:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463417.346580:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008abd6a7c/0xc3fe72277ee36bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.346600:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47ac600 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463417.346604:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008abd6a7c/0xc3fe72277ee36bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.346613:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008abd6a7c/0xc3fe72277ee36bd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.346627:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008abd6a7c/0xc3fe72277ee36bd3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.346635:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008abd6a7c/0xc3fe72277ee36bd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463417.346654:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463417.346657:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463417.346659:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788463417.347246:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.347253:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beca74fe/0xc3fe72277ee36bda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.347262:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.347266:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.347271:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beca74fe/0xc3fe72277ee36bda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.347281:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beca74fe/0xc3fe72277ee36bda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.347300:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beca74fe/0xc3fe72277ee36bda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.347316:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000beca74fe/0xc3fe72277ee36bda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.347375:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788463417.349111:0:15438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788463417.349125:0:15438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092fcacb1/0xc3fe72277ee36be1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.349144:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788463417.349151:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463417.349158:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092fcacb1/0xc3fe72277ee36be1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.349175:0:15438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092fcacb1/0xc3fe72277ee36be1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.349184:0:15438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092fcacb1/0xc3fe72277ee36be1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463417.349192:0:15438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092fcacb1/0xc3fe72277ee36be1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.349268:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788463417.349277:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000beca74fe/0xc3fe72277ee36bda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.349297:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47ad400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.349302:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000beca74fe/0xc3fe72277ee36bda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.349313:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000beca74fe/0xc3fe72277ee36bda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.349333:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000beca74fe/0xc3fe72277ee36bda lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.349342:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beca74fe/0xc3fe72277ee36bda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.349384:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463417.349388:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092fcacb1/0xc3fe72277ee36be1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.349394:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47ad000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463417.349397:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092fcacb1/0xc3fe72277ee36be1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.349405:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092fcacb1/0xc3fe72277ee36be1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.349416:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092fcacb1/0xc3fe72277ee36be1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463417.349424:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.349426:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463417.349428:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463417.349629:0:15438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788463417.349635:0:15438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092fcacb1/0xc3fe72277ee36be1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788463417.350191:0:15438:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788463417.350378:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8592680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14391:x1875339408148736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 141215us (141594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463417.350390:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788463417.350447:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463417.350607:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1875339408148736:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788463417.350628:0:14391:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788463417.350868:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1875339408148864:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788463417.350988:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463417.351084:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c35ffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788463417.351132:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408148864 00000100:00100000:2.0:1788463417.351143:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408148864 00000100:00100000:2.0:1788463417.351238:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463417.351250:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14391:x1875339408148864:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788463417.351320:0:15056:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1788463417.368920:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8590e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14391:x1875339408148864:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17663us (17922us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788463417.368935:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463417.369508:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14391:1875339408148864:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788463417.369527:0:14391:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788463417.572944:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788463418.525561:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788463418.525579:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1788463418.599765:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463419.626362:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463420.645783:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463421.671613:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788463422.501213:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463422.501220:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463422.501224:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463422.501232:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:0.0:1788463422.501238:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788463422.501246:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ba5c7de7800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463422.501270:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5e8590700 x1875339408149248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788463422.501330:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408148992:0@lo:400:kworker.0 00000100:00100000:0.0:1788463422.501402:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463422.501460:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788463422.501466:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408149120:0@lo:400:kworker.0 00000100:00100000:0.0:1788463422.501495:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463422.501534:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408149248:0@lo:8:kworker.0 00000100:00100000:0.0:1788463422.501556:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463422.501587:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408149376:0@lo:400:kworker.0 00000100:00100000:0.0:1788463422.501653:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463422.501674:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463422.501679:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5e8591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408149504:0@lo:400:kworker.0 00000100:00100000:0.0:1788463422.501722:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463422.501756:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408148992 00000100:00100000:0.0:1788463422.501764:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408148992 00000100:00100000:0.0:1788463422.501810:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788463422.501819:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5d44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+16:3276:x1875339408148992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463422.501867:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5d44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+16:3276:x1875339408148992:12345-0@lo:400:kworker.0 Request processed in 49us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463422.501875:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788463422.502021:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463422.502031:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408149632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463422.502060:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463422.502091:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408149632 00000100:00100000:2.0:1788463422.502095:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408149632 00000100:00100000:2.0:1788463422.502137:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463422.502149:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408149632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463422.502179:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463422.502226:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408149632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463422.502232:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788463422.502250:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463422.502544:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788463422.502567:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408149632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463422.502649:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408149120 00000100:00100000:0.0:1788463422.502654:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408149120 00000100:00100000:0.0:1788463422.502706:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408149248 00000100:00100000:0.0:1788463422.502710:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408149248 00000100:00100000:0.0:1788463422.502727:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463422.502734:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408149120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463422.502770:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408149120:12345-0@lo:400:kworker.0 Request processed in 37us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463422.502775:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463422.502786:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463422.502790:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3275:x1875339408149248:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788463422.502805:0:15438:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788463422.505929:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408149376 00000100:00100000:2.0:1788463422.505949:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408149376 00000100:00100000:2.0:1788463422.506012:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408149504 00000100:00100000:2.0:1788463422.506015:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408149504 00000100:00100000:2.0:1788463422.506056:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463422.506069:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408149376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463422.506178:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408149376:12345-0@lo:400:kworker.0 Request processed in 111us (4522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463422.506205:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463422.506224:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463422.506232:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408149504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463422.506264:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408149504:12345-0@lo:400:kworker.0 Request processed in 34us (4542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463422.506270:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788463422.506292:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788463422.506340:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5e8591f80 x1875339408149504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463422.506358:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8591f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408149504:0@lo:400:kworker.0 00010000:00080000:2.0:1788463422.506373:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5e8590000 x1875339408149376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463422.506382:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408149376:0@lo:400:kworker.0 00000100:00100000:3.0:1788463422.513825:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408149120:0@lo:400:kworker.0 00000100:00100000:3.0:1788463422.513845:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8593480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408148992:0@lo:400:kworker.0 00000100:00100000:0.0:1788463422.521752:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3275:x1875339408149248:12345-0@lo:8:kworker.0 Request processed in 18950us (20184us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788463422.521768:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788463422.522151:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463422.522159:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788463422.522164:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5e8590700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408149248:0@lo:8:kworker.0 00010000:00010000:1.0:1788463422.693982:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463423.335438:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788463423.718004:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463424.740815:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463425.765620:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788463426.248438:0:15776:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788463426.248443:0:15776:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788463426.249221:0:15776:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ba5c35d7800 00000020:01000004:1.0:1788463426.249239:0:15776:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788463426.249252:0:15776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788463426.249266:0:15776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ba5e841b380) 00000020:00000080:1.0:1788463426.249283:0:15776:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788463426.273302:0:15776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788463426.273899:0:15776:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788463426.274996:0:15776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788463426.275367:0:15776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788463426.276077:0:15776:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788463426.276672:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 245: rc = 0 00100000:10000000:2.0:1788463426.276904:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 245: rc = 0 00100000:10000000:2.0:1788463426.277050:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 245: rc = 0 00100000:10000000:2.0:1788463426.277655:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 896: rc = 0 00100000:10000000:2.0:1788463426.278077:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 896: rc = 0 00100000:10000000:2.0:1788463426.278616:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 896: rc = 0 00100000:10000000:2.0:1788463426.279308:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 896: rc = 0 00100000:10000000:2.0:1788463426.280061:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 896: rc = 0 00100000:10000000:2.0:1788463426.280761:0:15776:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 896: rc = 0 00000020:00000080:2.0:1788463426.281939:0:15776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788463426.281954:0:15776:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788463426.281966:0:15776:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3fe72277ee36bef 00000020:01000004:2.0:1788463426.281974:0:15776:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788463426.281998:0:15776:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788463426.282002:0:15776:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788463426.282012:0:15776:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788463426.282036:0:15776:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788463426.282041:0:15776:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788463426.296677:0:15776:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788463426.296807:0:15776:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.111@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788463426.296814:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788463426.296816:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463426.297245:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463426.297246:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463426.297248:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463426.297249:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463426.297251:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463426.297253:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463426.297254:0:15776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463426.297257:0:15776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788463426.297260:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463426.297261:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463426.297262:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463426.297263:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463426.297264:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463426.297265:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463426.297266:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463426.297267:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463426.297268:0:15776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788463426.297299:0:15776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788463426.297322:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408149760:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788463426.297413:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463426.297662:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408149760 00000100:00100000:0.0:1788463426.297669:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408149760 00000100:00100000:0.0:1788463426.297740:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788463426.297749:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e15cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+16:15776:x1875339408149760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788463426.297778:0:14363:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788463426.297781:0:14363:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788463426.297785:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788463426.298067:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c29eea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.313067:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e15cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+16:15776:x1875339408149760:12345-0@lo:253:mount.lustre.0 Request processed in 15308us (15643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.313082:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788463426.313262:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408149760:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788463426.313290:0:15776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788463426.313293:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788463426.313294:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463426.313295:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463426.313296:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463426.313297:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463426.313298:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463426.313299:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463426.313301:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463426.313302:0:15776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788463426.313324:0:15776:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ba5c35d7800 from lustre-OST0001 10000000:01000000:2.0:1788463426.313352:0:15776:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788463426.313355:0:15776:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788463426.313363:0:15776:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ba4c54ab380 local copy 00010000:00010000:2.0:1788463426.313373:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369a3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.313793:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408149888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463426.314255:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463426.314377:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0485840 going to sleep for 11 seconds 00000100:00100000:3.0:1788463426.314492:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408149888 00000100:00100000:3.0:1788463426.314500:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408149888 00000100:00100000:3.0:1788463426.314550:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788463426.314560:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe4c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+16:15776:x1875339408149888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463426.315230:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe4c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+16:15776:x1875339408149888:12345-0@lo:501:mount.lustre.0 Request processed in 669us (973us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788463426.315240:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788463426.318825:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408149888:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788463426.318862:0:15776:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788463426.319160:0:15776:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788463426.319171:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369a3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.319183:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5efaf7c00/0xc3fe72277ee3699c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee369a3 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463426.319218:0:15776:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ba5c35d7800 10000000:01000000:2.0:1788463426.319222:0:15776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788463426.319227:0:15776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788463426.319229:0:15776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463426.319234:0:15776:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788463426.319237:0:15776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788463426.319271:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38a00/0xc3fe72277ee36bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.319279:0:15776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38a00/0xc3fe72277ee36bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.319289:0:15776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38a00/0xc3fe72277ee36bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.319307:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463426.319365:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463426.319410:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0485840 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.319719:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408150016 00000100:00100000:1.0:1788463426.319733:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408150016 00000100:00100000:1.0:1788463426.319777:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788463426.319784:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe4c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+16:15776:x1875339408150016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788463426.319796:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463426.319808:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36bfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36bf6 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.319841:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36bf6 expref: 17 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.319852:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5efaf6600/0xc3fe72277ee36bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36bf6 expref: 17 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463426.319860:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5efaf6600, rc 0) 00000100:00100000:1.0:1788463426.319904:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe4c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+17:15776:x1875339408150016:12345-0@lo:101:mount.lustre.0 Request processed in 119us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.319910:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788463426.320249:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463426.320264:0:15776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38a00/0xc3fe72277ee36bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36bfd expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.320273:0:15776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38a00/0xc3fe72277ee36bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36bfd expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463426.321049:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788463426.325672:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463426.330963:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788463426.331061:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788463426.331097:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788463426.331345:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788463426.331385:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788463426.331421:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788463426.331918:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788463426.331929:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788463426.332082:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463426.332379:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463426.332634:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c35ff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463426.338781:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408150144 00000100:00100000:0.0:1788463426.338801:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408150144 00000100:00100000:0.0:1788463426.338881:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788463426.338893:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe4c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+17:15776:x1875339408150144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463426.339468:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe4c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+17:15776:x1875339408150144:12345-0@lo:501:mount.lustre.0 Request processed in 575us (7086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.339488:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788463426.340138:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463426.340216:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463426.340272:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463426.340318:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c35ff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.340364:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408150272 00000100:00100000:1.0:1788463426.340370:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408150272 00000100:00100000:1.0:1788463426.340415:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788463426.340424:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe4c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+17:15776:x1875339408150272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463426.340833:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe4c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+17:15776:x1875339408150272:12345-0@lo:503:mount.lustre.0 Request processed in 408us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.340842:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788463426.341521:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150272:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788463426.343401:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788463426.344167:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463426.344268:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463426.344312:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c35ff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.344479:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408150400 00000100:00100000:1.0:1788463426.344487:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408150400 00000100:00100000:1.0:1788463426.344543:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788463426.344552:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec1c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+17:15776:x1875339408150400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463426.345052:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec1c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+17:15776:x1875339408150400:12345-0@lo:502:mount.lustre.0 Request processed in 265us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.345060:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788463426.345812:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463426.346068:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788463426.346130:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788463426.346161:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788463426.346199:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788463426.346228:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788463426.346253:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788463426.346290:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788463426.346318:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788463426.346360:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788463426.346393:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463426.346445:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463426.346497:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c35ff0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463426.346651:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408150528 00000100:00100000:2.0:1788463426.346664:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408150528 00000100:00100000:2.0:1788463426.346729:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788463426.346737:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec1c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+17:15776:x1875339408150528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463426.349498:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec1c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+17:15776:x1875339408150528:12345-0@lo:502:mount.lustre.0 Request processed in 2752us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463426.349803:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788463426.350127:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463426.350287:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788463426.350304:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788463426.352320:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788463426.352333:0:15778:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788463426.352340:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463426.352343:0:15778:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788463426.352348:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788463426.352365:0:15778:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ba4c5190000) 00000020:00000080:3.0:1788463426.352392:0:15778:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788463426.352398:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788463426.352958:0:15778:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba5c35d7800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788463426.352968:0:15778:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788463426.352976:0:15778:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3fe72277ee36c0b 00010000:00010000:3.0:1788463426.360071:0:15778:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788463426.360949:0:15778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788463426.364732:0:15778:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788463426.368926:0:15778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788463426.368943:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463426.368951:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463426.368954:0:15778:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788463426.368958:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463426.368962:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463426.368963:0:15778:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788463426.368966:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788463426.368969:0:15778:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788463426.368971:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463426.368973:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463426.368975:0:15778:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788463426.368977:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788463426.368979:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463426.368980:0:15778:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788463426.368984:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788463426.369088:0:15778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788463426.369093:0:15778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788463426.369095:0:15778:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788463426.369099:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788463426.372672:0:15776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788463426.372736:0:15776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788463426.372762:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38a00/0xc3fe72277ee36bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36bfd expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.372776:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38a00/0xc3fe72277ee36bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36bfd expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463426.372784:0:15776:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c35d7800 from 1 10000000:01000000:2.0:1788463426.372787:0:15776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463426.372832:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.372842:0:15776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.372854:0:15776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.372883:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463426.372961:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463426.373009:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0485d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788463426.373607:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408150656 00000100:00100000:3.0:1788463426.373616:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408150656 00000100:00100000:3.0:1788463426.373676:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788463426.373709:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec1c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+17:15776:x1875339408150656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788463426.373724:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463426.373741:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36c19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36c12 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.373774:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36c19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36c12 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.373785:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36c19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36c12 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.373793:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1400, rc 0) 00000100:00100000:3.0:1788463426.373842:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec1c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408150656:12345-0@lo:101:mount.lustre.0 Request processed in 157us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463426.373849:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788463426.374126:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463426.374154:0:15776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.374167:0:15776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463426.375933:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788463426.380839:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463426.381202:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788463426.381249:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788463426.381315:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788463426.381323:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788463426.381428:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463426.381502:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463426.381556:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0485d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.383912:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408150784 00000100:00100000:1.0:1788463426.383932:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408150784 00000100:00100000:1.0:1788463426.383995:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788463426.384006:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408150784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788463426.384429:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408150784:12345-0@lo:501:mount.lustre.0 Request processed in 424us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.384439:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788463426.385787:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463426.385872:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463426.385951:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463426.385998:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4884b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.387239:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408150912 00000100:00100000:1.0:1788463426.387251:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408150912 00000100:00100000:1.0:1788463426.387322:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788463426.387331:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408150912:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788463426.388303:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408150912:12345-0@lo:503:mount.lustre.0 Request processed in 970us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.388314:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788463426.388487:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408150912:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788463426.389171:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788463426.389285:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463426.389354:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463426.389386:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4884b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.390229:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408151040 00000100:00100000:1.0:1788463426.390238:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408151040 00000100:00100000:1.0:1788463426.390304:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788463426.390314:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408151040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463426.390839:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408151040:12345-0@lo:502:mount.lustre.0 Request processed in 525us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.390847:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788463426.391983:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788463426.393197:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788463426.393302:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788463426.393357:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788463426.393394:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788463426.393429:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788463426.393497:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788463426.393535:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788463426.393566:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788463426.393621:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788463426.393747:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463426.393785:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0485780 going to sleep for 11 seconds 00000100:00100000:1.0:1788463426.394136:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408151168 00000100:00100000:1.0:1788463426.394146:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408151168 00000100:00100000:1.0:1788463426.394218:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788463426.394228:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408151168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788463426.394517:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408151168:12345-0@lo:502:mount.lustre.0 Request processed in 290us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.394526:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788463426.394756:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788463426.394891:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788463426.394913:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788463426.396662:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463426.396674:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463426.396676:0:15782:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788463426.396777:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba5c35d7800 00000020:00000080:0.0:1788463426.396781:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463426.396789:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463426.396791:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463426.396793:0:15782:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788463426.396795:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463426.396797:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463426.396799:0:15782:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788463426.396802:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ba5c35d7800 00000020:00000080:0.0:1788463426.396804:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463426.396919:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463426.396924:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463426.396925:0:15782:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788463426.396928:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788463426.396931:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463426.396932:0:15782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788463426.396935:0:15782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ba5c35d7800 00000020:00000080:0.0:1788463426.396937:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788463426.398945:0:15782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788463426.398960:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788463426.398962:0:15782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788463426.398967:0:15782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788463426.399175:0:15776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788463426.399208:0:15776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463426.399238:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.399250:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463426.399301:0:15776:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788463426.399304:0:15776:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ba5c35d7800 10000000:01000000:2.0:1788463426.399307:0:15776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ba5c35d7800 10000000:01000000:2.0:1788463426.399311:0:15776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788463426.399316:0:15776:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ba5c35d7800 from 1 10000000:01000000:2.0:1788463426.399319:0:15776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788463426.399359:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39400/0xc3fe72277ee36c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.399368:0:15776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39400/0xc3fe72277ee36c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.399379:0:15776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39400/0xc3fe72277ee36c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.399403:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788463426.399512:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463426.399562:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0485e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788463426.401909:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408151296 00000100:00100000:3.0:1788463426.401927:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408151296 00000100:00100000:0.0:1788463426.402129:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788463426.402145:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408151296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788463426.402171:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463426.402194:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c47ada00/0xc3fe72277ee36c27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36c20 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.402237:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c47ada00/0xc3fe72277ee36c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36c20 expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.402249:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c47ada00/0xc3fe72277ee36c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36c20 expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.402257:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47ada00, rc 0) 00000100:00100000:0.0:1788463426.402339:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:15776:x1875339408151296:12345-0@lo:101:mount.lustre.0 Request processed in 198us (2826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.402346:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788463426.402714:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788463426.402745:0:15776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39400/0xc3fe72277ee36c20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36c27 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.402757:0:15776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39400/0xc3fe72277ee36c20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36c27 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788463426.407336:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788463426.409996:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788463426.417520:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788463426.417610:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788463426.417637:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788463426.417674:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788463426.417731:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788463426.417770:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788463426.417802:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788463426.417837:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788463426.417886:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788463426.417925:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788463426.417958:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788463426.418001:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788463426.418036:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788463426.418068:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788463426.418109:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788463426.418182:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788463426.418214:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788463426.418259:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788463426.418297:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788463426.418331:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788463426.418392:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788463426.418431:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788463426.418467:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788463426.418516:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788463426.418553:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788463426.418584:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788463426.418628:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788463426.418663:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788463426.418724:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788463426.418786:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788463426.418826:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788463426.418877:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788463426.418915:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788463426.418967:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788463426.419006:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788463426.419058:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788463426.419095:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788463426.419195:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788463426.419202:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788463426.419321:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788463426.419398:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463426.419447:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0485e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463426.420429:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408151424 00000100:00100000:0.0:1788463426.420441:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408151424 00000100:00100000:0.0:1788463426.420609:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788463426.420620:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c55f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+19:15776:x1875339408151424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788463426.420921:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c55f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+19:15776:x1875339408151424:12345-0@lo:501:mount.lustre.0 Request processed in 302us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.420928:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788463426.420968:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788463426.421177:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788463426.421421:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463426.421458:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c35ffe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788463426.421601:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408151552 00000100:00100000:0.0:1788463426.421606:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408151552 00000100:00100000:0.0:1788463426.421634:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788463426.421641:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c370b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+19:15776:x1875339408151552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788463426.421986:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c370b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+19:15776:x1875339408151552:12345-0@lo:503:mount.lustre.0 Request processed in 343us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.421994:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788463426.422069:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151552:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788463426.427090:0:15776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788463426.428230:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463426.428341:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463426.428393:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c4f46240 going to sleep for 11 seconds 00000100:00100000:0.0:1788463426.428425:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408151680 00000100:00100000:0.0:1788463426.428434:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408151680 00000100:00100000:0.0:1788463426.428626:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788463426.428640:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c3709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:15776:x1875339408151680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463426.429021:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c3709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:15776:x1875339408151680:12345-0@lo:502:mount.lustre.0 Request processed in 384us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.429030:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788463426.432668:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788463426.433014:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788463426.433085:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788463426.434423:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788463426.434935:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788463426.434973:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788463426.435015:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788463426.435078:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788463426.435109:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788463426.436327:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788463426.436367:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788463426.436400:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788463426.436443:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788463426.437331:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788463426.437379:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788463426.437434:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788463426.438669:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788463426.438757:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788463426.438826:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788463426.438861:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788463426.438904:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788463426.438947:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788463426.438981:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788463426.439037:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788463426.439088:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788463426.439973:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788463426.440024:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788463426.440084:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788463426.440323:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788463426.440362:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788463426.440412:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788463426.440449:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788463426.440505:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788463426.440543:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788463426.440593:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788463426.440627:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788463426.440729:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788463426.440770:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788463426.440999:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788463426.441073:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788463426.441107:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788463426.441180:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788463426.441265:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463426.441312:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c4f46240 going to sleep for 11 seconds 00000100:00100000:3.0:1788463426.441409:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408151808 00000100:00100000:3.0:1788463426.441418:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408151808 00000100:00100000:3.0:1788463426.441488:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788463426.441498:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c3709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+19:15776:x1875339408151808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788463426.441748:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c3709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+19:15776:x1875339408151808:12345-0@lo:502:mount.lustre.0 Request processed in 251us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463426.441757:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788463426.441812:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408151808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788463426.441891:0:15776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788463426.441902:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788463426.443410:0:15787:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788463426.443851:0:15787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ba4c54a8000) 00000020:00000080:0.0:1788463426.443880:0:15787:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788463426.443964:0:15787:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ba5c35d7800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788463426.443970:0:15787:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ba5c35d7800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788463426.443972:0:15787:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ba5c35d7800 3 00010000:00080000:0.0:1788463426.444006:0:15787:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ba5e8be8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.111@tcp at head 00010000:00010000:0.0:1788463426.446062:0:15787:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788463426.446913:0:15787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788463426.446953:0:15787:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788463426.446967:0:15787:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc3fe72277ee36c35 00000100:00080000:0.0:1788463426.446978:0:15787:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788463426.446987:0:15787:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ba5e8be8000 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463426.447352:0:15787:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5ec22a680 x1875339408151936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788463426.447408:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875339408151936:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788463426.447483:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788463426.447549:0:15787:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788463426.447603:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788463426.447608:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788463426.447611:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788463426.447616:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 454 00000100:00080000:0.0:1788463426.447619:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788463426.447623:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ba5c7de7800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:0.0:1788463426.447636:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba5ec228e00 x1875339408152192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788463426.447705:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408151936 00000100:00100000:1.0:1788463426.447713:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408151936 00000100:00100000:1.0:1788463426.447747:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463426.447755:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3275:x1875339408151936:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788463426.447778:0:14368:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000100:00100000:2.0:1788463426.447918:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408152192:0@lo:8:kworker.0 00000100:00100000:2.0:1788463426.447949:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463426.447986:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408152064:0@lo:400:kworker.0 00000020:00000080:1.0:1788463426.448165:0:14368:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc3fe72277ee36c3c 00000004:00100000:1.0:1788463426.448183:0:14368:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788463426.448215:0:14368:0:(import.c:65:import_set_state_nolock()) ffff9ba5fe9ee000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463426.448589:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875339408152448:0@lo:400:kworker.0 00000100:00100000:2.0:1788463426.448640:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463426.448642:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875339408151936:12345-0@lo:38:llog_process_th.0 Request processed in 886us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.448650:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463426.448702:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408152192 00000100:00100000:2.0:1788463426.448707:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408152192 00000100:00100000:2.0:1788463426.448726:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408152064 00000100:00100000:2.0:1788463426.448728:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408152064 00000100:00100000:3.0:1788463426.448738:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463426.448744:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3275:x1875339408152192:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788463426.448794:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3275:x1875339408152192:12345-0@lo:8:kworker.0 Request processed in 48us (843us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788463426.448800:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463426.448994:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463426.449021:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463426.449029:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408152320:0@lo:400:kworker.0 00000100:00100000:0.0:1788463426.449052:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463426.449119:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463426.449130:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408152064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463426.449171:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408152064:12345-0@lo:400:kworker.0 Request processed in 45us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463426.449177:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788463426.449205:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463426.449237:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408152064:0@lo:400:kworker.0 00000100:00100000:2.0:1788463426.449264:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788463426.449270:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788463426.449346:0:3275:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788463426.449350:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408152192:0@lo:8:kworker.0 00010000:00080000:2.0:1788463426.449366:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5ec22a680 x1875339408151936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788463436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463426.449376:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788463426.449382:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788463426.449389:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788463426.449394:0:3275:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788463426.449396:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5e8be8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788463426.449401:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3275:1875339408151936:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788463426.449459:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408152448 00000100:00100000:1.0:1788463426.449464:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408152448 00000100:00100000:1.0:1788463426.449501:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408152320 00000100:00100000:1.0:1788463426.449505:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408152320 00000100:00100000:1.0:1788463426.449518:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463426.449524:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875339408152448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463426.449588:0:14370:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788463426.449597:0:14370:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1788463426.449604:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463426.449633:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875339408152448:12345-0@lo:400:kworker.0 Request processed in 109us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463426.449639:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463426.449652:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463426.449658:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408152320:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788463426.449816:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5ec22b100 x1875339408152448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463426.449826:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875339408152448:0@lo:400:kworker.0 00000100:00100000:1.0:1788463426.449958:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875339408152320:12345-0@lo:400:kworker.0 Request processed in 299us (904us total) trans 0 rc 0/0 00010000:00080000:0.0:1788463426.449963:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ba5ec228000 x1875339408152320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463426.449964:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788463426.449979:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875339408152320:0@lo:400:kworker.0 00000040:00080000:3.0:1788463426.450622:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788463426.450811:0:15776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788463426.450849:0:15776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788463426.450872:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39400/0xc3fe72277ee36c20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36c27 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463426.450883:0:15776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39400/0xc3fe72277ee36c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36c27 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788463426.450925:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788463426.450927:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463426.450932:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463426.450933:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463426.450934:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463426.450936:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463426.450937:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463426.450938:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463426.450940:0:15776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788463426.450944:0:15776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788463426.450946:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788463426.450947:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788463426.450948:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788463426.450949:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788463426.450949:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788463426.450951:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788463426.450952:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788463426.450952:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788463426.450954:0:15776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788463426.450980:0:15776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788463426.450995:0:15776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408152576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788463426.451080:0:15776:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463426.451131:0:15776:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5e0485900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463426.451189:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408152576 00000100:00100000:0.0:1788463426.451197:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408152576 00000100:00100000:0.0:1788463426.451352:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788463426.451362:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c370a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:15776:x1875339408152576:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788463426.451387:0:14361:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788463426.451400:0:14361:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788463426.496026:0:14361:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788463426.496044:0:14361:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788463426.496082:0:14384:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788463426.496088:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788463426.496199:0:14384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.496219:0:14384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5efaf6e00/0xc3fe72277ee36b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36b16 expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.496291:0:14384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.496335:0:14384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5efaf6e00/0xc3fe72277ee36b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee36b16 expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.496349:0:14384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba5efaf6e00/0xc3fe72277ee36b1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee36b16 expref: 19 pid: 14361 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463426.496364:0:14384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec228000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1875339408152704:0@lo:104: 00000100:00100000:0.0:1788463426.496438:0:14384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463426.496673:0:14384:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9b589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463426.496741:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408152704 00000100:00100000:0.0:1788463426.496750:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408152704 00000100:00100000:0.0:1788463426.496894:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788463426.496905:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b647fa9f-8776-4850-826f-89ba9b699661+3:14384:x1875339408152704:12345-0@lo:104: 00010000:00010000:0.0:1788463426.496920:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463426.496988:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463426.496995:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b647fa9f-8776-4850-826f-89ba9b699661+3:14384:x1875339408152704:12345-0@lo:104: Request processed in 92us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463426.497002:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788463426.497049:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463426.497056:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497064:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0e00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1788463426.497068:0:15442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497077:0:15442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788463426.497085:0:15442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788463426.497093:0:15442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788463426.497137:0:15442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497144:0:15442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788463426.497167:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497187:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b0e00/0xc3fe72277ee36b16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36b1d expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497203:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463426.497205:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463426.497207:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463426.497237:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408152832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788463426.497269:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463426.497305:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408152832 00000100:00100000:3.0:1788463426.497309:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408152832 00010000:00010000:3.0:1788463426.497327:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5efaf6e00/0xc3fe72277ee36b1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36b16 expref: 20 pid: 14361 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.497349:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463426.497356:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+20:3276:x1875339408152832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463426.497366:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463426.497371:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5efaf6e00/0xc3fe72277ee36b1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36b16 expref: 20 pid: 14361 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497381:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5efaf6e00/0xc3fe72277ee36b1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee36b16 expref: 20 pid: 14361 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497401:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497409:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788463426.497422:0:14353:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014673697s 00010000:00010000:3.0:1788463426.497435:0:14353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497441:0:14353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497448:0:14353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497454:0:14353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497477:0:14353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47ad000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463426.497481:0:14353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497489:0:14353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497498:0:14353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.497508:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463426.497536:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+20:3276:x1875339408152832:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463426.497542:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788463426.497579:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408152832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463426.498490:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5efaf6e00/0xc3fe72277ee36b1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee36b16 expref: 19 pid: 14361 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463426.498506:0:14384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec228000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14384:1875339408152704:0@lo:104: 00010000:00010000:3.0:1788463426.498535:0:14384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.498545:0:14384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.498550:0:14384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463426.498557:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36c43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463426.505267:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c370a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+18:15776:x1875339408152576:12345-0@lo:253:mount.lustre.0 Request processed in 53897us (54178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463426.505283:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788463426.505412:0:15776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b647fa9f-8776-4850-826f-89ba9b699661:15776:1875339408152576:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788463426.505434:0:15776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788463426.505437:0:15776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788463426.505439:0:15776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788463426.505441:0:15776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788463426.505442:0:15776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788463426.505443:0:15776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788463426.505445:0:15776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788463426.505447:0:15776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788463426.505449:0:15776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788463426.505451:0:15776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788463426.505579:0:15776:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788463426.512990:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463426.513299:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788463426.513450:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463426.516798:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788463426.517037:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788463426.518059:0:15776:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788463426.519676:0:15776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788463426.633423:0:15776:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788463426.633434:0:15776:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788463426.633485:0:15776:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788463426.633587:0:15776:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788463426.633601:0:15776:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788463426.633635:0:15776:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788463426.789251:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463427.626932:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788463427.626959:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408152960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788463427.627046:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463427.627103:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408152960 00000100:00100000:1.0:1788463427.627112:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408152960 00000100:00100000:1.0:1788463427.627173:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788463427.627183:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408152960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463427.627249:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463427.627316:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408152960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463427.627323:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788463427.627433:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408152960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788463427.813845:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788463428.388955:0:14365:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788463428.388964:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ba5ebded800 from 8 10000000:01000000:3.0:1788463428.388969:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788463428.389037:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b1000/0xc3fe72277ee36c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463428.389059:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b1000/0xc3fe72277ee36c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463428.389081:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b1000/0xc3fe72277ee36c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463428.389108:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408153088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788463428.389177:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463428.389228:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec804180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463428.389306:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408153088 00000100:00100000:0.0:1788463428.389314:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408153088 00000100:00100000:0.0:1788463428.389369:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788463428.389380:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c3709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+18:14365:x1875339408153088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463428.389395:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463428.389410:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c47ad400/0xc3fe72277ee36c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36c4a expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463428.389433:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c47ad400/0xc3fe72277ee36c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36c4a expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463428.389445:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c47ad400/0xc3fe72277ee36c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36c4a expref: 19 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463428.389456:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47ad400, rc 0) 00000100:00100000:0.0:1788463428.389511:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c3709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+19:14365:x1875339408153088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463428.389518:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788463428.389723:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408153088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463428.389746:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b1000/0xc3fe72277ee36c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36c51 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463428.389757:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b1000/0xc3fe72277ee36c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36c51 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463428.389815:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408153216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788463428.389849:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463428.389871:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec0660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463428.389919:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408153216 00000100:00100000:0.0:1788463428.389924:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408153216 00000100:00100000:0.0:1788463428.389953:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788463428.389960:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c3708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:14365:x1875339408153216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788463428.389975:0:14361:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788463428.389993:0:14361:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788463428.389997:0:14361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788463428.390068:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c3708850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:14365:x1875339408153216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463428.390085:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788463428.390117:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408153216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788463428.390174:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788463428.390182:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b1000/0xc3fe72277ee36c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36c51 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463428.390190:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba4c56b1000/0xc3fe72277ee36c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36c51 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463428.836938:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463429.863763:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463430.888216:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788463431.717585:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788463431.717592:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788463431.717596:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788463431.717608:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ba5c7de7800 using connection 192.168.204.111@tcp/0@lo 00000100:00100000:1.0:1788463431.717630:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ba4c7385f80 x1875339408153600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788463431.717736:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408153728:0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.717842:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463431.717897:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788463431.717903:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408153856:0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.717928:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463431.717961:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408153728 00000100:00100000:1.0:1788463431.717969:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408153728 00000100:00100000:1.0:1788463431.718022:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408153856 00000100:00100000:1.0:1788463431.718026:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408153856 00000100:00100000:1.0:1788463431.718059:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463431.718067:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408153728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463431.718123:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408153728:12345-0@lo:400:kworker.0 Request processed in 56us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463431.718131:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788463431.718148:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788463431.718154:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408153856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463431.718295:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408153472:0@lo:400:kworker.0 00000100:00100000:0.0:1788463431.718328:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463431.718354:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788463431.718360:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b647fa9f-8776-4850-826f-89ba9b699661:3279:1875339408153344:0@lo:400:kworker.0 00000100:00100000:0.0:1788463431.718387:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463431.718408:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408153984:0@lo:400:kworker.0 00000100:00100000:0.0:1788463431.718433:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463431.718452:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408153984 00000100:00100000:0.0:1788463431.718462:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408153984 00000100:00100000:0.0:1788463431.718485:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463431.718492:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408153984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463431.718526:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408153984:12345-0@lo:400:kworker.0 Request processed in 36us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463431.718532:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463431.718569:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408153472 00000100:00100000:0.0:1788463431.718572:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408153472 00000100:00100000:0.0:1788463431.718604:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463431.718610:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408153472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463431.718639:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408153472:12345-0@lo:400:kworker.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463431.718645:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788463431.718661:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408153344 00000100:00100000:0.0:1788463431.718664:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408153344 00000100:00100000:0.0:1788463431.718704:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788463431.718711:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c3708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:3279:x1875339408153344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463431.718739:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c3708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:3279:x1875339408153344:12345-0@lo:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463431.718745:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788463431.719064:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b647fa9f-8776-4850-826f-89ba9b699661:3279:1875339408153344:0@lo:400:kworker.0 00010000:00080000:0.0:1788463431.719079:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba4c7387800 x1875339408153984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788463431.719090:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408153984:0@lo:400:kworker.0 00000100:00100000:0.0:1788463431.719102:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408153472:0@lo:400:kworker.0 00000100:00100000:2.0:1788463431.720227:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408153600:0@lo:8:kworker.0 00000100:00100000:2.0:1788463431.720294:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463431.720353:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408153600 00000100:00100000:2.0:1788463431.720361:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408153600 00000100:00100000:2.0:1788463431.720394:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463431.720401:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3275:x1875339408153600:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788463431.720431:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1788463431.720461:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3fe72277ee36c58 00002000:00100000:2.0:1788463431.720475:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ba5ebdda800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788463431.720480:0:15055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788463431.720482:0:15055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788463431.720852:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788463431.720879:0:15055:0:(import.c:65:import_set_state_nolock()) ffff9ba5ebdd8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463431.720932:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3275:x1875339408153600:12345-0@lo:8:kworker.0 Request processed in 529us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463431.720940:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788463431.720985:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba4c7385f80 x1875339408153600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788463456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788463431.721031:0:3275:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788463431.721043:0:3275:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788463431.721048:0:3275:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788463431.721051:0:3275:0:(import.c:65:import_set_state_nolock()) ffff9ba5c7de7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788463431.721076:0:3275:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788463431.721081:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3275:1875339408153600:0@lo:8:kworker.0 00000100:00100000:1.0:1788463431.721343:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408153856:12345-0@lo:400:kworker.0 Request processed in 3187us (3413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463431.721353:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1788463431.721411:0:14393:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788463431.721430:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1875339408154240:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788463431.721478:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463431.721496:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c7d40840 going to sleep for 11 seconds 00000100:00080000:1.0:1788463431.721518:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463431.721524:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463431.721531:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788463431.721540:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408154112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463431.721565:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463431.721605:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408154112 00000100:00100000:1.0:1788463431.721611:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408154112 00000100:00100000:1.0:1788463431.721648:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788463431.721656:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875339408154112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463431.721680:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463431.721737:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875339408154112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463431.721744:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788463431.721757:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788463431.721778:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba4c7385f80 x1875339408154112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788463447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788463431.721793:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408154112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788463431.721812:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408154240 00000004:00080000:0.0:1788463431.722092:0:14392:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788463431.724273:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408154240 00000100:00100000:1.0:1788463431.724391:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788463431.724401:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14393:x1875339408154240:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788463431.725627:0:14392:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 463335940852ns, next at 0ns, rc = 0 00010000:00080000:3.0:1788463431.728071:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba4c7386300 x1875339408153856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463431.728096:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408153856:0@lo:400:kworker.0 00010000:00080000:3.0:1788463431.728114:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba4c7386d80 x1875339408153728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788463431.728122:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408153728:0@lo:400:kworker.0 00002000:00080000:1.0:1788463431.744280:0:15056:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788463431.744294:0:15056:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788463431.744300:0:15056:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1788463431.785628:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.785640:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.785656:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.785660:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.785666:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.787180:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.787195:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.787204:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.787237:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463431.787761:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463431.787770:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.787780:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463431.787786:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.787797:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.787828:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.787838:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.787886:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.787888:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.787890:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.790191:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.790205:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.790222:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.790228:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.790235:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.790251:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.790262:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.790270:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.790296:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463431.790314:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463431.790319:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.790338:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6c00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463431.790343:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.790352:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.790369:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.790376:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.790403:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.790405:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.790407:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.791788:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.791798:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086967dfd/0xc3fe72277ee36c6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.791813:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.791817:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.791822:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086967dfd/0xc3fe72277ee36c6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.791836:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086967dfd/0xc3fe72277ee36c6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.791855:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086967dfd/0xc3fe72277ee36c6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.791864:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086967dfd/0xc3fe72277ee36c6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.791887:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463431.792040:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463431.792048:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086967dfd/0xc3fe72277ee36c6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.792057:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463431.792062:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086967dfd/0xc3fe72277ee36c6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.792071:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086967dfd/0xc3fe72277ee36c6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.792090:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086967dfd/0xc3fe72277ee36c6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.792098:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086967dfd/0xc3fe72277ee36c6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.792125:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463431.792128:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463431.792129:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.812803:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.816775:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cca5cb1/0xc3fe72277ee36c74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.816801:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.816806:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.816813:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cca5cb1/0xc3fe72277ee36c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.816829:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cca5cb1/0xc3fe72277ee36c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.816840:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cca5cb1/0xc3fe72277ee36c74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.816848:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cca5cb1/0xc3fe72277ee36c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.816920:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463431.817315:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463431.817322:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cca5cb1/0xc3fe72277ee36c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.817329:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6e00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463431.817334:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cca5cb1/0xc3fe72277ee36c74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.817342:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cca5cb1/0xc3fe72277ee36c74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.817372:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cca5cb1/0xc3fe72277ee36c74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.817380:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cca5cb1/0xc3fe72277ee36c74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.817411:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463431.817413:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463431.817415:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.817549:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.817556:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000552d9b59/0xc3fe72277ee36c7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.817564:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.817567:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.817572:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000552d9b59/0xc3fe72277ee36c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.817582:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000552d9b59/0xc3fe72277ee36c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.817590:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000552d9b59/0xc3fe72277ee36c7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.817596:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000552d9b59/0xc3fe72277ee36c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.817616:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788463431.818027:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.818032:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818040:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.818049:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.818053:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818062:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818070:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818077:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818101:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788463431.818144:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463431.818150:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000552d9b59/0xc3fe72277ee36c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818159:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf7200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463431.818168:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000552d9b59/0xc3fe72277ee36c7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818189:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000552d9b59/0xc3fe72277ee36c7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818202:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000552d9b59/0xc3fe72277ee36c7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818209:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000552d9b59/0xc3fe72277ee36c7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818226:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463431.818230:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818236:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6c00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463431.818240:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818247:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818257:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818264:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065a4f0ef/0xc3fe72277ee36c82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818284:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463431.818286:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463431.818287:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.818465:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.818471:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818479:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.818482:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.818487:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818496:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818504:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818517:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818538:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463431.818701:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463431.818707:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818715:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463431.818718:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818726:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818737:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818744:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009561556/0xc3fe72277ee36c89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.818758:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463431.818760:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463431.818761:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.818935:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.818941:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4798f96/0xc3fe72277ee36c90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818949:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.818952:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.818956:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4798f96/0xc3fe72277ee36c90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818965:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4798f96/0xc3fe72277ee36c90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818973:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4798f96/0xc3fe72277ee36c90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818980:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4798f96/0xc3fe72277ee36c90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.818993:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463431.819595:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463431.819601:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4798f96/0xc3fe72277ee36c90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.819610:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf7000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463431.819613:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4798f96/0xc3fe72277ee36c90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.819621:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4798f96/0xc3fe72277ee36c90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.819633:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4798f96/0xc3fe72277ee36c90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.819639:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4798f96/0xc3fe72277ee36c90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.819658:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463431.819659:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463431.819661:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.822659:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.826806:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.826825:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade78eb1/0xc3fe72277ee36c97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.826843:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.826848:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.826854:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade78eb1/0xc3fe72277ee36c97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.826869:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ade78eb1/0xc3fe72277ee36c97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.826880:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade78eb1/0xc3fe72277ee36c97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.826889:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ade78eb1/0xc3fe72277ee36c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.826912:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788463431.827151:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788463431.827161:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ade78eb1/0xc3fe72277ee36c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.827177:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5efaf6400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463431.827182:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade78eb1/0xc3fe72277ee36c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.827207:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade78eb1/0xc3fe72277ee36c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.827222:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ade78eb1/0xc3fe72277ee36c97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.827229:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade78eb1/0xc3fe72277ee36c97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463431.827265:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463431.827267:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463431.827269:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.833377:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.833389:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e0f18bd/0xc3fe72277ee36c9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.833407:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.833412:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.833420:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e0f18bd/0xc3fe72277ee36c9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.833435:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e0f18bd/0xc3fe72277ee36c9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.833454:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e0f18bd/0xc3fe72277ee36c9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.833462:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e0f18bd/0xc3fe72277ee36c9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.833488:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788463431.833960:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.833966:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b09b80d/0xc3fe72277ee36ca5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.833975:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.833978:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.833982:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b09b80d/0xc3fe72277ee36ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.833992:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b09b80d/0xc3fe72277ee36ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834000:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b09b80d/0xc3fe72277ee36ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834019:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b09b80d/0xc3fe72277ee36ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834046:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788463431.834062:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463431.834068:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e0f18bd/0xc3fe72277ee36c9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834075:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463431.834080:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e0f18bd/0xc3fe72277ee36c9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834090:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e0f18bd/0xc3fe72277ee36c9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834110:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e0f18bd/0xc3fe72277ee36c9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834119:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e0f18bd/0xc3fe72277ee36c9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834151:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463431.834155:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b09b80d/0xc3fe72277ee36ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834161:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488e00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463431.834163:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.834164:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b09b80d/0xc3fe72277ee36ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834185:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b09b80d/0xc3fe72277ee36ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834196:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b09b80d/0xc3fe72277ee36ca5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834202:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b09b80d/0xc3fe72277ee36ca5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.834217:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.834218:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.834220:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.838786:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.838797:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d442c478/0xc3fe72277ee36cac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.838813:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.839101:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.839110:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d442c478/0xc3fe72277ee36cac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.839126:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d442c478/0xc3fe72277ee36cac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.839136:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d442c478/0xc3fe72277ee36cac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.839149:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d442c478/0xc3fe72277ee36cac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.839275:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463431.842333:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463431.842348:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d442c478/0xc3fe72277ee36cac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.843104:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488c00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.843111:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d442c478/0xc3fe72277ee36cac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.843125:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d442c478/0xc3fe72277ee36cac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.843157:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d442c478/0xc3fe72277ee36cac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.843167:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d442c478/0xc3fe72277ee36cac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.843260:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.843263:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.843265:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463431.847261:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788463431.847274:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2d5c1c5/0xc3fe72277ee36cb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.847292:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1788463431.847297:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463431.847304:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2d5c1c5/0xc3fe72277ee36cb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.847318:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2d5c1c5/0xc3fe72277ee36cb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.847329:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2d5c1c5/0xc3fe72277ee36cb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.847336:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2d5c1c5/0xc3fe72277ee36cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.847381:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788463431.847866:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788463431.847872:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf2e0b3/0xc3fe72277ee36cba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.847882:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1788463431.847885:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463431.847891:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf2e0b3/0xc3fe72277ee36cba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.847900:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdf2e0b3/0xc3fe72277ee36cba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.847908:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf2e0b3/0xc3fe72277ee36cba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.847915:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf2e0b3/0xc3fe72277ee36cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.847933:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788463431.848340:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788463431.848346:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000add591c3/0xc3fe72277ee36cc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848355:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1788463431.848364:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463431.848369:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000add591c3/0xc3fe72277ee36cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848379:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000add591c3/0xc3fe72277ee36cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848388:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000add591c3/0xc3fe72277ee36cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848396:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000add591c3/0xc3fe72277ee36cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848411:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788463431.848427:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788463431.848434:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2d5c1c5/0xc3fe72277ee36cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848442:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0e00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.848447:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2d5c1c5/0xc3fe72277ee36cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848458:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2d5c1c5/0xc3fe72277ee36cb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848476:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2d5c1c5/0xc3fe72277ee36cb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848494:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2d5c1c5/0xc3fe72277ee36cb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848512:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463431.848516:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdf2e0b3/0xc3fe72277ee36cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848521:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.848524:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf2e0b3/0xc3fe72277ee36cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848530:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf2e0b3/0xc3fe72277ee36cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848538:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdf2e0b3/0xc3fe72277ee36cba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848545:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdf2e0b3/0xc3fe72277ee36cba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848553:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463431.848556:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000add591c3/0xc3fe72277ee36cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848561:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.848570:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000add591c3/0xc3fe72277ee36cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848577:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000add591c3/0xc3fe72277ee36cc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848588:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000add591c3/0xc3fe72277ee36cc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848594:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000add591c3/0xc3fe72277ee36cc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.848606:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.848608:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.848610:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463431.850920:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788463431.850933:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000463315/0xc3fe72277ee36cc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.850950:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1788463431.850955:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463431.850961:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000463315/0xc3fe72277ee36cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.850976:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000463315/0xc3fe72277ee36cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.850987:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000463315/0xc3fe72277ee36cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.851003:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000463315/0xc3fe72277ee36cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.851042:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463431.851066:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463431.851073:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000463315/0xc3fe72277ee36cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.851080:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0a00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.851085:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000463315/0xc3fe72277ee36cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.851095:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000463315/0xc3fe72277ee36cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.851114:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000463315/0xc3fe72277ee36cc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.851123:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000463315/0xc3fe72277ee36cc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.851145:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.851146:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.851148:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.853562:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788463431.853787:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788463431.853803:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ac3547/0xc3fe72277ee36ccf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.853820:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1788463431.853825:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463431.853832:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040ac3547/0xc3fe72277ee36ccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.853848:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040ac3547/0xc3fe72277ee36ccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.853859:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040ac3547/0xc3fe72277ee36ccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.853866:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040ac3547/0xc3fe72277ee36ccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.853892:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788463431.854398:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788463431.854405:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c951f11c/0xc3fe72277ee36cd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.854413:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1788463431.854416:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463431.854421:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c951f11c/0xc3fe72277ee36cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.854431:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c951f11c/0xc3fe72277ee36cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.854447:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c951f11c/0xc3fe72277ee36cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.854453:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c951f11c/0xc3fe72277ee36cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.854469:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788463431.854497:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788463431.854506:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040ac3547/0xc3fe72277ee36ccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.854516:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463431.854522:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ac3547/0xc3fe72277ee36ccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.854534:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040ac3547/0xc3fe72277ee36ccf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.854558:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040ac3547/0xc3fe72277ee36ccf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.854566:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040ac3547/0xc3fe72277ee36ccf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.854593:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463431.854597:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c951f11c/0xc3fe72277ee36cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.854615:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1a00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463431.854619:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c951f11c/0xc3fe72277ee36cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.854627:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c951f11c/0xc3fe72277ee36cd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.854639:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c951f11c/0xc3fe72277ee36cd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.854646:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c951f11c/0xc3fe72277ee36cd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.854661:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.854663:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.854665:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.854672:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788463431.856660:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788463431.856865:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.856874:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000305b7326/0xc3fe72277ee36cdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.856891:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.856895:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.856902:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000305b7326/0xc3fe72277ee36cdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.856930:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000305b7326/0xc3fe72277ee36cdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.856940:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000305b7326/0xc3fe72277ee36cdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.856948:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000305b7326/0xc3fe72277ee36cdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.856965:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788463431.856975:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463431.856981:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000305b7326/0xc3fe72277ee36cdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.856988:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463431.856993:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000305b7326/0xc3fe72277ee36cdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.857002:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000305b7326/0xc3fe72277ee36cdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.857030:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000305b7326/0xc3fe72277ee36cdd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.857038:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000305b7326/0xc3fe72277ee36cdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.857077:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.857079:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463431.857081:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463431.857331:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.858234:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.858243:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd6febc0/0xc3fe72277ee36ce4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.858255:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.858259:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.858265:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6febc0/0xc3fe72277ee36ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.858277:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd6febc0/0xc3fe72277ee36ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.858287:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd6febc0/0xc3fe72277ee36ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.858295:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6febc0/0xc3fe72277ee36ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.858324:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463431.858445:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463431.858452:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd6febc0/0xc3fe72277ee36ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.858461:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489c00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.858466:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd6febc0/0xc3fe72277ee36ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.858476:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd6febc0/0xc3fe72277ee36ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.858504:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd6febc0/0xc3fe72277ee36ce4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.858512:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd6febc0/0xc3fe72277ee36ce4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.858534:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.858542:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.858544:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.858757:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.858763:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad58578/0xc3fe72277ee36ceb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.858781:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.858784:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.858788:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ad58578/0xc3fe72277ee36ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.858797:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ad58578/0xc3fe72277ee36ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.858804:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad58578/0xc3fe72277ee36ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.858811:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ad58578/0xc3fe72277ee36ceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.858828:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788463431.859229:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.859235:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af6f5db/0xc3fe72277ee36cf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.859243:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.859246:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.859250:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007af6f5db/0xc3fe72277ee36cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.859259:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007af6f5db/0xc3fe72277ee36cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.859278:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af6f5db/0xc3fe72277ee36cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.859285:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007af6f5db/0xc3fe72277ee36cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.863087:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788463431.863145:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788463431.863158:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ad58578/0xc3fe72277ee36ceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.863173:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489400 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.863179:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad58578/0xc3fe72277ee36ceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.863193:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad58578/0xc3fe72277ee36ceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.863220:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ad58578/0xc3fe72277ee36ceb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.863228:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ad58578/0xc3fe72277ee36ceb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.863261:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463431.863265:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007af6f5db/0xc3fe72277ee36cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.863271:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.863273:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007af6f5db/0xc3fe72277ee36cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.863291:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007af6f5db/0xc3fe72277ee36cf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.863301:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007af6f5db/0xc3fe72277ee36cf2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.863308:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007af6f5db/0xc3fe72277ee36cf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.863322:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.863323:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.863325:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463431.863467:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.864540:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.864549:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061502c2/0xc3fe72277ee36cf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.864565:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.864569:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.864576:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000061502c2/0xc3fe72277ee36cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.864590:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000061502c2/0xc3fe72277ee36cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.864601:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000061502c2/0xc3fe72277ee36cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.864609:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000061502c2/0xc3fe72277ee36cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.864650:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463431.864918:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463431.864926:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000061502c2/0xc3fe72277ee36cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.864933:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488600 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.864938:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000061502c2/0xc3fe72277ee36cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.864947:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000061502c2/0xc3fe72277ee36cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.864963:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000061502c2/0xc3fe72277ee36cf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.864980:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000061502c2/0xc3fe72277ee36cf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.865022:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.865024:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.865026:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.865720:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.865728:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee36d00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.865742:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.865746:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.865751:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee36d00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.865763:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee36d00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.865772:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee36d00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.865779:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee36d00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.865799:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463431.867247:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463431.867264:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee36d00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.867280:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.867288:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee36d00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.867300:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee36d00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.867323:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee36d00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.867331:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084b51ebd/0xc3fe72277ee36d00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.867378:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.867380:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.867382:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.869381:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.869393:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093dc49db/0xc3fe72277ee36d07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.869412:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.869422:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.869429:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093dc49db/0xc3fe72277ee36d07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.869444:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093dc49db/0xc3fe72277ee36d07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.869455:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093dc49db/0xc3fe72277ee36d07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.869463:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093dc49db/0xc3fe72277ee36d07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.869493:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788463431.869613:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463431.869622:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093dc49db/0xc3fe72277ee36d07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.869638:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463431.869643:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093dc49db/0xc3fe72277ee36d07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.869654:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093dc49db/0xc3fe72277ee36d07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.869672:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093dc49db/0xc3fe72277ee36d07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.869680:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093dc49db/0xc3fe72277ee36d07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463431.869742:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463431.869745:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463431.869746:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.873827:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.873848:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d832a63d/0xc3fe72277ee36d0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.873868:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.873872:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.873879:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d832a63d/0xc3fe72277ee36d0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.873895:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d832a63d/0xc3fe72277ee36d0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.873906:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d832a63d/0xc3fe72277ee36d0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.873926:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d832a63d/0xc3fe72277ee36d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.873952:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463431.874284:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463431.874292:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d832a63d/0xc3fe72277ee36d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.874300:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.874305:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d832a63d/0xc3fe72277ee36d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.874313:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d832a63d/0xc3fe72277ee36d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.874333:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d832a63d/0xc3fe72277ee36d0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.874343:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d832a63d/0xc3fe72277ee36d0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.874378:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.874380:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.874382:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.876650:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.876662:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36d15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.876678:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.878546:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.878564:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36d15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.878588:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36d15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.878600:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36d15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.878609:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36d15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.878637:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463431.880266:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463431.880284:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36d15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.880297:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.880305:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36d15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.880337:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36d15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.880365:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36d15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.880373:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028dd9c01/0xc3fe72277ee36d15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.880420:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.880421:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.880423:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788463431.880873:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788463431.880881:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36d1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.880899:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788463431.880904:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463431.880911:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36d1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.880928:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36d1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.880939:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36d1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.880946:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36d1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463431.880969:0:15056:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788463431.881215:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788463431.881221:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36d1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.881229:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463431.881234:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36d1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.881243:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36d1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.881256:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36d1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.881274:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000742025d6/0xc3fe72277ee36d1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463431.881300:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.881302:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788463431.881303:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788463431.883565:0:15056:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1788463431.885998:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14393:x1875339408154240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 161583us (164504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463431.886027:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788463431.886227:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1875339408154240:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788463431.886247:0:14393:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788463431.886311:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1875339408154368:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788463431.886382:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463431.886433:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec8043c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463431.886468:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408154368 00000100:00100000:1.0:1788463431.886487:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408154368 00000100:00100000:1.0:1788463431.886581:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788463431.886605:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14393:x1875339408154368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788463431.886747:0:15055:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1788463431.911047:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463431.913128:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14393:x1875339408154368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 26532us (26738us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788463431.913150:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788463431.916545:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14393:1875339408154368:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788463431.916570:0:14393:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788463432.743104:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408154496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463432.743190:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463432.743259:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408154496 00000100:00100000:2.0:1788463432.743268:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408154496 00000100:00100000:2.0:1788463432.743316:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463432.743326:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408154496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463432.743546:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463432.745843:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408154496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2504us (2639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463432.745880:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463432.747662:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408154496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463432.935919:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788463433.589123:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788463433.962391:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463434.985504:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463436.006454:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788463436.071378:0:16136:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg411-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788463436.843790:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408154624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463436.843882:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463436.843956:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408155136:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.843981:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463436.844006:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788463436.844013:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408155008:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.844037:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463436.844075:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b647fa9f-8776-4850-826f-89ba9b699661:3278:1875339408154752:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.844405:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463436.844455:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408155264:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.844482:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463436.844504:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788463436.844510:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408154880:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.844533:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463436.844552:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408155392:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.844573:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463436.844610:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408154624 00000100:00100000:2.0:1788463436.844620:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408154624 00000100:00100000:2.0:1788463436.844680:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463436.844714:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875339408154624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463436.844771:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463436.844828:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8590700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875339408154624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.844835:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788463436.844861:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408155136 00000100:00100000:2.0:1788463436.844865:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408155136 00000100:00100000:2.0:1788463436.844892:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408155264 00000100:00100000:2.0:1788463436.844895:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408155264 00000100:00100000:2.0:1788463436.844920:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408155392 00000100:00100000:2.0:1788463436.844923:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408155392 00000100:00100000:2.0:1788463436.844939:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463436.844945:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408155136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.844979:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8593480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875339408155136:12345-0@lo:400:kworker.0 Request processed in 33us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.844985:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463436.844998:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463436.845003:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408155264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.845033:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875339408155264:12345-0@lo:400:kworker.0 Request processed in 29us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.845039:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463436.845050:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463436.845056:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408155392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.845081:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408155392:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.845087:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788463436.845105:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408155008 00000100:00100000:2.0:1788463436.845359:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408155008 00000100:00100000:2.0:1788463436.845397:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408154880 00000100:00100000:2.0:1788463436.845400:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408154880 00000100:00100000:2.0:1788463436.845424:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463436.845431:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3277:x1875339408155008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.845480:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8590380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3277:x1875339408155008:12345-0@lo:400:kworker.0 Request processed in 50us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.845486:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788463436.845498:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463436.845504:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408154880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.845530:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408154880:12345-0@lo:400:kworker.0 Request processed in 27us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.845535:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788463436.845554:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408154752 00000100:00100000:2.0:1788463436.845558:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408154752 00000100:00100000:2.0:1788463436.845585:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788463436.845590:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+19:3278:x1875339408154752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.845618:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+19:3278:x1875339408154752:12345-0@lo:400:kworker.0 Request processed in 28us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463436.845623:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788463436.845724:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408154880:0@lo:400:kworker.0 00010000:00080000:2.0:1788463436.845742:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c328c000 x1875339408155392/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463436.845752:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408155392:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.845760:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b647fa9f-8776-4850-826f-89ba9b699661:3278:1875339408154752:0@lo:400:kworker.0 00010000:00080000:2.0:1788463436.845769:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c328f480 x1875339408155264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463436.845786:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3278:1875339408155264:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.845831:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408155008:0@lo:400:kworker.0 00000100:00100000:2.0:1788463436.845847:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408154624:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788463436.845859:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ba5c328ce00 x1875339408155136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788463452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788463436.845866:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875339408155136:0@lo:400:kworker.0 00000100:00080000:3.0:1788463436.858930:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788463436.858941:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788463436.858944:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788463436.995656:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788463436.995763:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788463437.036004:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463437.863407:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408155520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788463437.863495:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463437.863574:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408155520 00000100:00100000:1.0:1788463437.863581:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408155520 00000100:00100000:1.0:1788463437.863636:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463437.863646:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408155520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463437.863706:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463437.863757:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408155520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463437.863765:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788463437.863833:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408155520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788463438.053872:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463439.076890:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463439.267636:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463439.273360:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395572864 00000100:00100000:0.0:1788463439.273377:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395572864 00000100:00100000:0.0:1788463439.273496:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 78 00000100:00100000:0.0:1788463439.273508:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1875339395572864:12345-192.168.204.11@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788463439.273540:0:14363:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9427fd67-5406-46ba-9ba0-54796a705559@192.168.204.11@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:0.0:1788463439.273593:0:14363:0:(genops.c:1385:class_connect()) connect: client 9427fd67-5406-46ba-9ba0-54796a705559, cookie 0xc3fe72277ee36d23 00000100:00080000:0.0:1788463439.273779:0:14363:0:(import.c:65:import_set_state_nolock()) ffff9ba4c66b8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463439.273875:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+5:2353:x1875339395572864:12345-192.168.204.11@tcp:250:mount.lustre.0 Request processed in 356us (6238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463439.273885:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 78 00000100:00100000:2.0:1788463439.281813:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463439.281923:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395572992 00000100:00100000:0.0:1788463439.281936:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395572992 00000100:00100000:0.0:1788463439.282002:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 79 00000100:00100000:0.0:1788463439.282014:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+5:13749:x1875339395572992:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788463439.282035:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463439.282058:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c47ade00/0xc3fe72277ee36d2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e164 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.282096:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c47ade00/0xc3fe72277ee36d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e164 expref: 6 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.282110:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c47ade00/0xc3fe72277ee36d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e164 expref: 6 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.282121:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47ade00, rc 0) 00000100:00100000:0.0:1788463439.282205:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+6:13749:x1875339395572992:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 192us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463439.282222:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 79 00000100:00100000:3.0:1788463439.286726:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463439.288147:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395573120 00000100:00100000:0.0:1788463439.288163:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395573120 00000100:00100000:0.0:1788463439.288247:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 80 00000100:00100000:0.0:1788463439.288258:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+6:13749:x1875339395573120:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788463439.288769:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+6:13749:x1875339395573120:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 511us (2081us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788463439.288778:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 80 00000100:00100000:3.0:1788463439.292208:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463439.292374:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395573248 00000100:00100000:2.0:1788463439.292386:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395573248 00000100:00100000:2.0:1788463439.292444:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 81 00000100:00100000:2.0:1788463439.292456:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+6:13749:x1875339395573248:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788463439.292475:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463439.292499:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5f7d38200/0xc3fe72277ee36d31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e16b expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463439.292535:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5f7d38200/0xc3fe72277ee36d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e16b expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463439.292547:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5f7d38200/0xc3fe72277ee36d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e16b expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463439.292557:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38200, rc 0) 00000100:00100000:2.0:1788463439.292618:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+7:13749:x1875339395573248:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 163us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.292637:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 81 00000100:00100000:3.0:1788463439.297981:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463439.298087:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395573376 00000100:00100000:2.0:1788463439.298098:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395573376 00000100:00100000:2.0:1788463439.298153:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 82 00000100:00100000:2.0:1788463439.298162:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+7:13749:x1875339395573376:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788463439.298491:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+8:13749:x1875339395573376:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 329us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.298500:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 82 00000100:00100000:3.0:1788463439.300266:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463439.300393:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395573504 00000100:00100000:0.0:1788463439.300403:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395573504 00000100:00100000:0.0:1788463439.300462:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 83 00000100:00100000:0.0:1788463439.300472:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+8:13749:x1875339395573504:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788463439.300883:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+8:13749:x1875339395573504:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 411us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463439.300891:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 83 00000100:00100000:0.0:1788463439.314804:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463439.314904:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395573632 00000100:00100000:3.0:1788463439.314916:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395573632 00000100:00100000:3.0:1788463439.314975:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 84 00000100:00100000:3.0:1788463439.314984:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+8:13768:x1875339395573632:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788463439.315651:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+8:13768:x1875339395573632:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 666us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463439.315666:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 84 00000100:00100000:3.0:1788463439.359358:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463439.359644:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395573760 00000100:00100000:2.0:1788463439.359656:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395573760 00000100:00100000:2.0:1788463439.359758:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 85 00000100:00100000:2.0:1788463439.359770:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+8:13768:x1875339395573760:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463439.360120:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+8:13768:x1875339395573760:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 352us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.360128:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 85 00000100:00100000:2.0:1788463439.367510:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463439.367834:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395573888 00000100:00100000:3.0:1788463439.367846:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395573888 00000100:00100000:3.0:1788463439.367928:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00100000:3.0:1788463439.367939:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+8:13749:x1875339395573888:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788463439.367959:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463439.367983:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee36d38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e195 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463439.368020:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee36d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e195 expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463439.368033:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b0a00/0xc3fe72277ee36d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e195 expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463439.368045:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0a00, rc 0) 00000100:00100000:3.0:1788463439.368136:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+9:13749:x1875339395573888:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 199us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463439.368143:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 86 00000100:00100000:3.0:1788463439.375821:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463439.376231:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395574016 00000100:00100000:0.0:1788463439.376245:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395574016 00000100:00100000:0.0:1788463439.376310:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 87 00000100:00100000:0.0:1788463439.376322:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+9:13749:x1875339395574016:12345-192.168.204.11@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788463439.376357:0:14363:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788463439.376386:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788463439.376390:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788463439.376394:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788463439.376396:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788463439.383530:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+9:13749:x1875339395574016:12345-192.168.204.11@tcp:256:mount.lustre.0 Request processed in 7195us (7709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.383558:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 87 00000100:00100000:2.0:1788463439.402074:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463439.402438:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395574144 00000100:00100000:0.0:1788463439.402449:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395574144 00000100:00100000:0.0:1788463439.402514:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 88 00000100:00100000:0.0:1788463439.402525:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+9:13749:x1875339395574144:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788463439.402545:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463439.402578:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c47ad800/0xc3fe72277ee36d3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e19c expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.402639:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c47ad800/0xc3fe72277ee36d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e19c expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.402653:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c47ad800/0xc3fe72277ee36d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e19c expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.402663:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47ad800, rc 0) 00000100:00100000:0.0:1788463439.402756:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+10:13749:x1875339395574144:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 232us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463439.402763:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 88 00000100:00100000:2.0:1788463439.414430:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463439.414585:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395574272 00000100:00100000:1.0:1788463439.414599:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395574272 00000100:00100000:1.0:1788463439.414707:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 89 00000100:00100000:1.0:1788463439.414719:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+10:13749:x1875339395574272:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788463439.415086:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+10:13749:x1875339395574272:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 369us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463439.415095:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 89 00000100:00100000:2.0:1788463439.425971:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463439.426113:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395574400 00000100:00100000:3.0:1788463439.426123:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395574400 00000100:00100000:3.0:1788463439.426175:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 90 00000100:00100000:3.0:1788463439.426186:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ebc84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+10:13749:x1875339395574400:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788463439.426604:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ebc84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+10:13749:x1875339395574400:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 418us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463439.426844:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 90 00000100:00100000:1.0:1788463439.432202:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463439.432522:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395574528 00000100:00100000:2.0:1788463439.432533:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395574528 00000100:00100000:2.0:1788463439.432597:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 91 00000100:00100000:2.0:1788463439.432622:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+10:13772:x1875339395574528:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463439.433117:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+10:13772:x1875339395574528:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 496us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.433127:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 91 00000100:00100000:2.0:1788463439.442507:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463439.442724:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395574656 00000100:00100000:1.0:1788463439.442736:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395574656 00000100:00100000:1.0:1788463439.442800:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 92 00000100:00100000:1.0:1788463439.442811:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+10:13772:x1875339395574656:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463439.444133:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+10:13772:x1875339395574656:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 1313us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463439.444147:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 92 00000100:00100000:0.0:1788463439.464134:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463439.464321:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395574784 00000100:00100000:2.0:1788463439.464333:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395574784 00000100:00100000:2.0:1788463439.464386:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:2.0:1788463439.464395:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1875339395574784:12345-192.168.204.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788463439.464434:0:15790:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2fe540e5-01dd-4c4d-bd30-a716e1b2c216@192.168.204.11@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1788463439.464500:0:15790:0:(genops.c:1385:class_connect()) connect: client 2fe540e5-01dd-4c4d-bd30-a716e1b2c216, cookie 0xc3fe72277ee36d46 00000004:00100000:2.0:1788463439.464541:0:15790:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788463439.464549:0:15790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788463439.494403:0:15790:0:(import.c:65:import_set_state_nolock()) ffff9ba4c66bd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463439.494500:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2353:x1875339395574784:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 30103us (30385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463439.494512:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:2.0:1788463439.499011:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463439.499120:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463439.500997:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395574912 00000100:00100000:1.0:1788463439.501015:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395574912 00000100:00100000:0.0:1788463439.501072:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395575040 00000100:00100000:0.0:1788463439.501077:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395575040 00000100:00100000:0.0:1788463439.501235:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:0.0:1788463439.501249:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:13749:x1875339395575040:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788463439.501310:0:14368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788463439.501432:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:13749:x1875339395575040:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 186us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463439.501442:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:0.0:1788463439.501499:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:0.0:1788463439.501506:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:0:x1875339395574912:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788463439.501550:0:14370:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788463439.501575:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:0:x1875339395574912:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 69us (2577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463439.501581:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00080000:3.0:1788463439.502865:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463439.512924:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463439.513039:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395575168 00000100:00100000:0.0:1788463439.513050:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395575168 00000100:00100000:0.0:1788463439.513160:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:0.0:1788463439.513173:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:13749:x1875339395575168:12345-192.168.204.11@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788463439.513288:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:13749:x1875339395575168:12345-192.168.204.11@tcp:40:mount.lustre.0 Request processed in 118us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463439.513296:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:2.0:1788463439.518938:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463439.518982:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463439.519024:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463439.519178:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395575296 00000100:00100000:1.0:1788463439.519190:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395575296 00000100:00100000:0.0:1788463439.519198:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395575552 00000100:00100000:0.0:1788463439.519202:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395575552 00000100:00100000:0.0:1788463439.519255:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:0.0:1788463439.519266:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:13749:x1875339395575552:12345-192.168.204.11@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788463439.519298:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395575424 00000100:00100000:1.0:1788463439.519302:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395575424 00000100:00100000:1.0:1788463439.519321:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1788463439.519327:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1875339395575296:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788463439.519355:0:15438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2fe540e5-01dd-4c4d-bd30-a716e1b2c216@192.168.204.11@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1788463439.519394:0:15438:0:(genops.c:1385:class_connect()) connect: client 2fe540e5-01dd-4c4d-bd30-a716e1b2c216, cookie 0xc3fe72277ee36d4d 00002000:00100000:1.0:1788463439.519409:0:15438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2fe540e5-01dd-4c4d-bd30-a716e1b2c216/ffff9ba5fe9ea800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788463439.519439:0:15438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788463439.519779:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:2.0:1788463439.519786:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875339395575424:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788463439.519802:0:15056:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2fe540e5-01dd-4c4d-bd30-a716e1b2c216@192.168.204.11@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1788463439.519819:0:15056:0:(genops.c:1385:class_connect()) connect: client 2fe540e5-01dd-4c4d-bd30-a716e1b2c216, cookie 0xc3fe72277ee36d54 00002000:00100000:2.0:1788463439.519824:0:15056:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2fe540e5-01dd-4c4d-bd30-a716e1b2c216/ffff9ba4c620d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788463439.519870:0:15056:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788463439.519924:0:15438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788463439.519956:0:15438:0:(import.c:65:import_set_state_nolock()) ffff9ba5fe9e8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788463439.520027:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2353:x1875339395575296:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 699us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463439.520036:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00002000:00080000:2.0:1788463439.520212:0:15056:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788463439.520227:0:15056:0:(import.c:65:import_set_state_nolock()) ffff9ba4c620a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463439.520252:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2353:x1875339395575424:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 466us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463439.520259:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000004:00080000:0.0:1788463439.524820:0:14371:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5462us 00000004:00200000:3.0:1788463439.542197:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788463439.542368:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:13749:x1875339395575552:12345-192.168.204.11@tcp:33:mount.lustre.0 Request processed in 23095us (23429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463439.542386:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:2.0:1788463439.867491:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463439.867576:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395575680 00000100:00100000:0.0:1788463439.867588:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395575680 00000100:00100000:0.0:1788463439.867669:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:0.0:1788463439.867680:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:13794:x1875339395575680:12345-192.168.204.11@tcp:101:mkdir.0 00010000:00010000:0.0:1788463439.867750:0:15790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463439.867787:0:15790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ad000/0xc3fe72277ee36d5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e1c6 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.867889:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36d62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.867922:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.867952:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788463439.867995:0:15790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788463439.868000:0:15790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788463439.868043:0:15790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36d62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.868075:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ad000/0xc3fe72277ee36d5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1c6 expref: 8 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.868097:0:15790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36d62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1c6 expref: 7 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463439.868107:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5caa41d00) 00010000:00010000:0.0:1788463439.868111:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788463439.868115:0:15790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47adc00, rc 0) 00000100:00100000:0.0:1788463439.868180:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:13794:x1875339395575680:12345-192.168.204.11@tcp:101:mkdir.0 Request processed in 502us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463439.868187:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00010000:00010000:1.0:1788463440.100949:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463441.124903:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788463441.957091:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408155776:0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.957105:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b647fa9f-8776-4850-826f-89ba9b699661:3277:1875339408155648:0@lo:400:kworker.0 00000100:00100000:1.0:1788463441.957223:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408156032:0@lo:400:kworker.0 00000100:00100000:2.0:1788463441.957283:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408155904:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.957619:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.957673:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408156288:0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.957732:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463441.957780:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408156288 00000100:00100000:3.0:1788463441.957787:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408156288 00000100:00100000:3.0:1788463441.958263:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463441.958273:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408156288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.958497:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875339408156288:12345-0@lo:400:kworker.0 Request processed in 225us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463441.958505:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788463441.958549:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3278:1875339408156288:0@lo:400:kworker.0 00000100:00080000:3.0:1788463441.958584:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463441.960495:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408155776 00000100:00100000:3.0:1788463441.960510:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408155776 00000100:00100000:3.0:1788463441.960576:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788463441.960586:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408155776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.960664:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408155776:12345-0@lo:400:kworker.0 Request processed in 80us (3046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463441.960752:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788463441.961801:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463441.961933:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408155776:0@lo:400:kworker.0 00000100:00100000:1.0:1788463441.963576:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463441.963669:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408156032 00000100:00100000:1.0:1788463441.963678:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408156032 00000100:00100000:1.0:1788463441.963743:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463441.963761:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408156032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463441.963827:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408156032:12345-0@lo:400:kworker.0 Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463441.963834:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788463441.963876:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408156032:0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.964122:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463441.964171:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408156160:0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.964202:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463441.964235:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408156160 00000100:00100000:0.0:1788463441.964239:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408156160 00000100:00100000:0.0:1788463441.964279:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788463441.964286:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408156160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.964389:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875339408156160:12345-0@lo:400:kworker.0 Request processed in 103us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463441.964396:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788463441.964416:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463441.964433:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3277:1875339408156160:0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.964492:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408155648 00000100:00100000:0.0:1788463441.964497:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408155648 00000100:00100000:0.0:1788463441.964523:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788463441.964528:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:3277:x1875339408155648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463441.964564:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:3277:x1875339408155648:12345-0@lo:400:kworker.0 Request processed in 36us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463441.964570:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788463441.964602:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b647fa9f-8776-4850-826f-89ba9b699661:3277:1875339408155648:0@lo:400:kworker.0 00000100:00100000:2.0:1788463441.969431:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463441.969486:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408156416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788463441.969519:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463441.969553:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408156416 00000100:00100000:2.0:1788463441.969562:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408156416 00000100:00100000:2.0:1788463441.969626:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788463441.969635:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408156416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788463441.969670:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463441.969734:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408156416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463441.969742:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788463441.969768:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463441.969793:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788463441.969850:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408156416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463441.970175:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408155904 00000100:00100000:3.0:1788463441.970180:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408155904 00000100:00100000:3.0:1788463441.970211:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788463441.970218:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408155904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463441.970262:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408155904:12345-0@lo:400:kworker.0 Request processed in 44us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463441.970268:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788463441.970385:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408155904:0@lo:400:kworker.0 00000001:00100000:2.0:1788463442.022927:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2fe540e5-01dd-4c4d-bd30-a716e1b2c216 00010000:00010000:2.0:1788463442.151282:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463442.177277:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463442.177450:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395575808 00000100:00100000:1.0:1788463442.177461:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395575808 00000100:00100000:1.0:1788463442.177617:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:1.0:1788463442.177635:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:13846:x1875339395575808:12345-192.168.204.11@tcp:41:lfs.0 00000004:00000024:1.0:1788463442.177726:0:14369:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788463442.177839:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:13846:x1875339395575808:12345-192.168.204.11@tcp:41:lfs.0 Request processed in 211us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463442.177847:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00080000:2.0:1788463442.179136:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463442.183793:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463442.183980:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395575936 00000100:00100000:3.0:1788463442.183992:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395575936 00000100:00100000:3.0:1788463442.184074:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:3.0:1788463442.184084:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:13846:x1875339395575936:12345-192.168.204.11@tcp:13:lfs.0 00002000:00000024:3.0:1788463442.184126:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463442.184234:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:13846:x1875339395575936:12345-192.168.204.11@tcp:13:lfs.0 Request processed in 151us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463442.184242:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00080000:2.0:1788463442.184822:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788463442.186328:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463442.188613:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395576064 00000100:00100000:2.0:1788463442.188635:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395576064 00000100:00100000:2.0:1788463442.188765:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:2.0:1788463442.188778:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:13846:x1875339395576064:12345-192.168.204.11@tcp:13:lfs.0 00002000:00000024:2.0:1788463442.189099:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463442.189280:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:13846:x1875339395576064:12345-192.168.204.11@tcp:13:lfs.0 Request processed in 503us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463442.189405:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00080000:0.0:1788463442.189528:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463442.442153:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463442.442332:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395576192 00000100:00100000:1.0:1788463442.442343:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395576192 00000100:00100000:1.0:1788463442.442416:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 94 00000100:00100000:1.0:1788463442.442429:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+10:13877:x1875339395576192:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788463442.442446:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463442.442465:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c1489c00/0xc3fe72277ee36d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e1cd expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463442.442498:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1489c00/0xc3fe72277ee36d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1cd expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463442.442511:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c1489c00/0xc3fe72277ee36d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1cd expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463442.442541:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489c00, rc 0) 00000100:00100000:1.0:1788463442.442606:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+11:13877:x1875339395576192:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 179us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463442.442614:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 94 00000100:00100000:1.0:1788463442.455478:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463442.455612:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395576320 00000100:00100000:0.0:1788463442.455622:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395576320 00000100:00100000:0.0:1788463442.455718:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 95 00000100:00100000:0.0:1788463442.455729:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+11:13877:x1875339395576320:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788463442.456117:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+11:13877:x1875339395576320:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 389us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.456126:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 95 00000100:00100000:3.0:1788463442.463417:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463442.463661:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395576448 00000100:00100000:0.0:1788463442.463712:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395576448 00000100:00100000:0.0:1788463442.463776:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 96 00000100:00100000:0.0:1788463442.463787:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+11:13877:x1875339395576448:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788463442.464073:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+11:13877:x1875339395576448:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 287us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.464082:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 96 00000100:00100000:3.0:1788463442.491180:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463442.491718:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395576576 00000100:00100000:1.0:1788463442.491731:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395576576 00000100:00100000:1.0:1788463442.491796:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 97 00000100:00100000:1.0:1788463442.491818:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+11:13885:x1875339395576576:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788463442.492119:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+11:13885:x1875339395576576:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 302us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463442.492141:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 97 00000100:00100000:1.0:1788463442.518316:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463442.518518:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395576704 00000100:00100000:3.0:1788463442.518529:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395576704 00000100:00100000:3.0:1788463442.518597:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 98 00000100:00100000:3.0:1788463442.518608:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+11:13885:x1875339395576704:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788463442.519144:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+11:13885:x1875339395576704:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 535us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463442.519516:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 98 00000100:00100000:3.0:1788463442.525722:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463442.525794:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395576832 00000100:00100000:0.0:1788463442.525816:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395576832 00000100:00100000:0.0:1788463442.525880:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 99 00000100:00100000:0.0:1788463442.525891:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+11:13877:x1875339395576832:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788463442.525908:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463442.525927:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e1f7 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463442.525961:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1f7 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463442.525973:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c47ad000/0xc3fe72277ee36d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1f7 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463442.525982:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47ad000, rc 0) 00000100:00100000:0.0:1788463442.526050:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+12:13877:x1875339395576832:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 161us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.526058:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 99 00000100:00100000:2.0:1788463442.534232:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463442.535023:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395576960 00000100:00100000:1.0:1788463442.535035:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395576960 00000100:00100000:1.0:1788463442.535103:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 100 00000100:00100000:1.0:1788463442.535114:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+12:13877:x1875339395576960:12345-192.168.204.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788463442.535140:0:14363:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788463442.535181:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788463442.535185:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788463442.535188:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788463442.535191:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788463442.539863:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+12:13877:x1875339395576960:12345-192.168.204.11@tcp:256:mount.lustre.0 Request processed in 4739us (5631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463442.539879:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 100 00000100:00100000:3.0:1788463442.556516:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463442.556642:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395577088 00000100:00100000:0.0:1788463442.556654:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395577088 00000100:00100000:0.0:1788463442.556758:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 101 00000100:00100000:0.0:1788463442.556770:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c9639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+12:13877:x1875339395577088:12345-192.168.204.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788463442.556818:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463442.556843:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c47ac600/0xc3fe72277ee36d77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e1fe expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463442.556882:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c47ac600/0xc3fe72277ee36d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1fe expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463442.556895:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c47ac600/0xc3fe72277ee36d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1fe expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463442.556906:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47ac600, rc 0) 00000100:00100000:0.0:1788463442.556992:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c9639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+13:13877:x1875339395577088:12345-192.168.204.11@tcp:101:mount.lustre.0 Request processed in 223us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.556999:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 101 00000100:00100000:3.0:1788463442.572525:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463442.572764:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395577216 00000100:00100000:2.0:1788463442.572775:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395577216 00000100:00100000:2.0:1788463442.572853:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 102 00000100:00100000:2.0:1788463442.572865:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+13:13877:x1875339395577216:12345-192.168.204.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788463442.573454:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+13:13877:x1875339395577216:12345-192.168.204.11@tcp:501:mount.lustre.0 Request processed in 588us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463442.573464:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 102 00000100:00100000:1.0:1788463442.576081:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463442.576198:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395577344 00000100:00100000:0.0:1788463442.576214:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395577344 00000100:00100000:0.0:1788463442.576290:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 103 00000100:00100000:0.0:1788463442.576301:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+13:13877:x1875339395577344:12345-192.168.204.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788463442.576534:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+13:13877:x1875339395577344:12345-192.168.204.11@tcp:503:mount.lustre.0 Request processed in 232us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.576541:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 103 00000100:00100000:3.0:1788463442.583084:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463442.584499:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395577472 00000100:00100000:0.0:1788463442.584512:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395577472 00000100:00100000:0.0:1788463442.584584:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 104 00000100:00100000:0.0:1788463442.584596:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+13:13890:x1875339395577472:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788463442.585181:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+13:13890:x1875339395577472:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 584us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.585197:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 104 00000100:00100000:3.0:1788463442.600314:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463442.600516:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395577600 00000100:00100000:2.0:1788463442.600527:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395577600 00000100:00100000:2.0:1788463442.600591:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 105 00000100:00100000:2.0:1788463442.600633:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c963a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+13:13890:x1875339395577600:12345-192.168.204.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788463442.600960:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c963a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+13:13890:x1875339395577600:12345-192.168.204.11@tcp:502:llog_process_th.0 Request processed in 330us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463442.600970:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 105 00000100:00100000:2.0:1788463442.625530:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463442.625574:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463442.625927:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395577728 00000100:00100000:0.0:1788463442.625938:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395577728 00000100:00100000:0.0:1788463442.625992:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395578112 00000100:00100000:0.0:1788463442.625995:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395578112 00000100:00100000:0.0:1788463442.626027:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:0.0:1788463442.626038:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2355:x1875339395578112:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463442.626143:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2355:x1875339395578112:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 105us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.626152:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:0.0:1788463442.626173:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:0.0:1788463442.626179:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1875339395577728:12345-192.168.204.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788463442.626205:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c05684b1-3635-43d8-b3a2-83c073790679@192.168.204.11@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1788463442.626285:0:14370:0:(genops.c:1385:class_connect()) connect: client c05684b1-3635-43d8-b3a2-83c073790679, cookie 0xc3fe72277ee36d7e 00000004:00100000:0.0:1788463442.626322:0:14370:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788463442.626389:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00080000:0.0:1788463442.626502:0:14370:0:(import.c:65:import_set_state_nolock()) ffff9ba5c5fe4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788463442.626523:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463442.626883:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395578368 00000100:00100000:3.0:1788463442.626890:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395578368 00000100:00100000:3.0:1788463442.626925:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395578240 00000100:00100000:3.0:1788463442.626929:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395578240 00000100:00100000:2.0:1788463442.626949:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:2.0:1788463442.626960:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2355:x1875339395578368:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463442.627000:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2355:x1875339395578368:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 44us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.627050:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05684b1-3635-43d8-b3a2-83c073790679+6:2353:x1875339395577728:12345-192.168.204.11@tcp:38:mount.lustre.0 Request processed in 363us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.627060:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:3.0:1788463442.627379:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:3.0:1788463442.627390:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2355:x1875339395578240:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463442.627437:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2355:x1875339395578240:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 51us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463442.627443:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:2.0:1788463442.631388:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1788463442.636742:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463442.636972:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395577984 00000100:00100000:3.0:1788463442.636984:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395577984 00000100:00080000:0.0:1788463442.637064:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788463442.637078:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:3.0:1788463442.637092:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05684b1-3635-43d8-b3a2-83c073790679+6:13877:x1875339395577984:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788463442.637216:0:15790:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788463442.637295:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05684b1-3635-43d8-b3a2-83c073790679+6:13877:x1875339395577984:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 206us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463442.637304:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:3.0:1788463442.638507:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463442.638619:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395577856 00000100:00100000:1.0:1788463442.638634:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395577856 00000100:00100000:1.0:1788463442.638774:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:1.0:1788463442.638785:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05684b1-3635-43d8-b3a2-83c073790679+6:0:x1875339395577856:12345-192.168.204.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788463442.638828:0:14368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788463442.638895:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05684b1-3635-43d8-b3a2-83c073790679+6:0:x1875339395577856:12345-192.168.204.11@tcp:41:mount.lustre.0 Request processed in 113us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463442.638902:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:0.0:1788463442.643647:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463442.648669:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395578496 00000100:00100000:2.0:1788463442.648697:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395578496 00000100:00100000:2.0:1788463442.648788:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1788463442.648810:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05684b1-3635-43d8-b3a2-83c073790679+6:13877:x1875339395578496:12345-192.168.204.11@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788463442.648921:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05684b1-3635-43d8-b3a2-83c073790679+6:13877:x1875339395578496:12345-192.168.204.11@tcp:40:mount.lustre.0 Request processed in 123us (5287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463442.648928:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:3.0:1788463442.654251:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463442.654301:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463442.654338:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463442.654497:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395578624 00000100:00100000:0.0:1788463442.654510:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395578624 00000100:00100000:0.0:1788463442.654559:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395578752 00000100:00100000:0.0:1788463442.654562:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395578752 00000100:00100000:0.0:1788463442.654584:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:0.0:1788463442.654611:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1875339395578624:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788463442.654648:0:15438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c05684b1-3635-43d8-b3a2-83c073790679@192.168.204.11@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1788463442.654716:0:15438:0:(genops.c:1385:class_connect()) connect: client c05684b1-3635-43d8-b3a2-83c073790679, cookie 0xc3fe72277ee36d85 00002000:00100000:0.0:1788463442.654732:0:15438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c05684b1-3635-43d8-b3a2-83c073790679/ffff9ba5c5fe0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788463442.654746:0:15438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788463442.654900:0:15438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788463442.654933:0:15438:0:(import.c:65:import_set_state_nolock()) ffff9ba5c5fe0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463442.655003:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05684b1-3635-43d8-b3a2-83c073790679+6:2353:x1875339395578624:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 394us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.655012:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:0.0:1788463442.655033:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:0.0:1788463442.655038:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1875339395578752:12345-192.168.204.11@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788463442.655053:0:15438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c05684b1-3635-43d8-b3a2-83c073790679@192.168.204.11@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1788463442.655072:0:15438:0:(genops.c:1385:class_connect()) connect: client c05684b1-3635-43d8-b3a2-83c073790679, cookie 0xc3fe72277ee36d8c 00002000:00100000:0.0:1788463442.655078:0:15438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c05684b1-3635-43d8-b3a2-83c073790679/ffff9ba5c5fe3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788463442.655085:0:15438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788463442.657330:0:15438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788463442.657373:0:15438:0:(import.c:65:import_set_state_nolock()) ffff9ba5c5fe6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788463442.657457:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05684b1-3635-43d8-b3a2-83c073790679+6:2353:x1875339395578752:12345-192.168.204.11@tcp:8:mount.lustre.0 Request processed in 2414us (3114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463442.657469:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:2.0:1788463442.657635:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395578880 00000100:00100000:2.0:1788463442.657645:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395578880 00000100:00100000:2.0:1788463442.657719:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:2.0:1788463442.657730:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05684b1-3635-43d8-b3a2-83c073790679+6:13877:x1875339395578880:12345-192.168.204.11@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788463442.657830:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788463442.657905:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05684b1-3635-43d8-b3a2-83c073790679+6:13877:x1875339395578880:12345-192.168.204.11@tcp:33:mount.lustre.0 Request processed in 177us (3603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463442.657913:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:3.0:1788463442.958224:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463442.958304:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395579008 00000100:00100000:2.0:1788463442.958314:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395579008 00000100:00100000:2.0:1788463442.958390:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:2.0:1788463442.958403:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05684b1-3635-43d8-b3a2-83c073790679+6:13911:x1875339395579008:12345-192.168.204.11@tcp:101:mkdir.0 00010000:00010000:2.0:1788463442.958427:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463442.958455:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee36d93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e228 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463442.958535:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463442.958551:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463442.958567:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463442.958744:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788463442.958750:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463442.958778:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463442.958819:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee36d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e228 expref: 8 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463442.958844:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e228 expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463442.958879:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5caa41d00) 00010000:00010000:2.0:1788463442.958883:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463442.958887:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39800, rc 0) 00000100:00100000:2.0:1788463442.959557:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05684b1-3635-43d8-b3a2-83c073790679+7:13911:x1875339395579008:12345-192.168.204.11@tcp:101:mkdir.0 Request processed in 1148us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463442.959568:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:2.0:1788463442.981495:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408156544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463442.981579:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463442.981923:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408156544 00000100:00100000:3.0:1788463442.981933:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408156544 00000100:00100000:3.0:1788463442.981992:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788463442.982002:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408156544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788463442.982026:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463442.982292:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408156544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 290us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463442.982301:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788463442.982904:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408156544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788463443.173498:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788463443.829108:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1788463444.099513:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c05684b1-3635-43d8-b3a2-83c073790679 00000001:00100000:0.0:1788463444.099543:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2fe540e5-01dd-4c4d-bd30-a716e1b2c216 00010000:00010000:2.0:1788463444.196944:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788463444.570422:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c05684b1-3635-43d8-b3a2-83c073790679 00000001:00100000:1.0:1788463444.570436:0:5839:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2fe540e5-01dd-4c4d-bd30-a716e1b2c216 00010000:00010000:2.0:1788463445.223065:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463446.250514:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788463446.460984:0:16346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788463447.079923:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408156928:0@lo:400:kworker.0 00000100:00100000:0.0:1788463447.079923:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408157184:0@lo:400:kworker.0 00000100:00100000:3.0:1788463447.080029:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b647fa9f-8776-4850-826f-89ba9b699661:3277:1875339408156672:0@lo:400:kworker.0 00000100:00100000:2.0:1788463447.082078:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463447.082160:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408157440:0@lo:400:kworker.0 00000100:00100000:2.0:1788463447.082194:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463447.082225:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788463447.082233:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408156800:0@lo:400:kworker.0 00000100:00100000:2.0:1788463447.082265:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463447.082284:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c328f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875339408157312:0@lo:400:kworker.0 00000100:00100000:2.0:1788463447.082303:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463447.082334:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408157440 00000100:00100000:2.0:1788463447.082342:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408157440 00000100:00100000:1.0:1788463447.082399:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408156928 00000100:00100000:2.0:1788463447.082401:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408157312 00000100:00100000:2.0:1788463447.082403:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408157312 00000100:00100000:1.0:1788463447.082403:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408156928 00000100:00100000:2.0:1788463447.082445:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788463447.082454:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408157440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463447.082524:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875339408157440:12345-0@lo:400:kworker.0 Request processed in 70us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463447.082532:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788463447.082548:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788463447.082554:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875339408157312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788463447.082579:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875339408157312:12345-0@lo:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463447.082586:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788463447.082603:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788463447.082607:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463447.082643:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3279:1875339408157312:0@lo:400:kworker.0 00000100:00100000:1.0:1788463447.082653:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408156800 00000100:00100000:1.0:1788463447.082656:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408156800 00000100:00100000:1.0:1788463447.082702:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463447.082720:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408156928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463447.082756:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408156928:12345-0@lo:400:kworker.0 Request processed in 47us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463447.082762:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788463447.082773:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788463447.082778:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408156800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463447.082802:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408156800:12345-0@lo:400:kworker.0 Request processed in 24us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463447.082807:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788463447.082965:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788463447.082983:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408156928:0@lo:400:kworker.0 00000100:00100000:2.0:1788463447.082993:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3279:1875339408157440:0@lo:400:kworker.0 00000100:00100000:2.0:1788463447.083016:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408156800:0@lo:400:kworker.0 00000100:00100000:3.0:1788463447.084100:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463447.084145:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408156672 00000100:00100000:3.0:1788463447.084154:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408156672 00000100:00100000:3.0:1788463447.084195:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788463447.084203:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+19:3277:x1875339408156672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463447.084259:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+19:3277:x1875339408156672:12345-0@lo:400:kworker.0 Request processed in 56us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463447.084265:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788463447.084318:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b647fa9f-8776-4850-826f-89ba9b699661:3277:1875339408156672:0@lo:400:kworker.0 00000100:00100000:3.0:1788463447.084329:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408157056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463447.084357:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463447.084380:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408157056 00000100:00100000:3.0:1788463447.084384:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408157056 00000100:00100000:3.0:1788463447.084421:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463447.084427:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408157056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463447.084453:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463447.084487:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408157056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463447.084493:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788463447.084528:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408157056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463447.085874:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463447.086114:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408157184 00000100:00100000:1.0:1788463447.086123:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408157184 00000100:00100000:1.0:1788463447.086193:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788463447.086222:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408157184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463447.086281:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875339408157184:12345-0@lo:400:kworker.0 Request processed in 64us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463447.086289:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788463447.086766:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c328d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875339408157184:0@lo:400:kworker.0 00000001:00100000:2.0:1788463447.178565:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c05684b1-3635-43d8-b3a2-83c073790679 00010000:00010000:2.0:1788463447.269504:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463447.763818:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463447.763860:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463447.763899:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463447.763922:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463447.763941:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463447.763964:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463447.764089:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395579136 00000100:00100000:3.0:1788463447.764100:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395579136 00000100:00100000:3.0:1788463447.764152:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 107 00000100:00100000:3.0:1788463447.764162:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+13:2354:x1875339395579136:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463447.764234:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+13:2354:x1875339395579136:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 73us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463447.764242:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 107 00000100:00100000:0.0:1788463447.764281:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463447.764409:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395579648 00000100:00100000:0.0:1788463447.764414:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395579648 00000100:00100000:0.0:1788463447.764457:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395579264 00000100:00100000:0.0:1788463447.764459:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395579264 00000100:00100000:0.0:1788463447.764483:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:0.0:1788463447.764489:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05684b1-3635-43d8-b3a2-83c073790679+6:2354:x1875339395579648:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463447.764525:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05684b1-3635-43d8-b3a2-83c073790679+6:2354:x1875339395579648:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 35us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463447.764532:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:0.0:1788463447.764545:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:0.0:1788463447.764551:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2354:x1875339395579264:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463447.764572:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2354:x1875339395579264:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 22us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463447.764577:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:0.0:1788463447.764612:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395579392 00000100:00100000:0.0:1788463447.764616:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395579392 00000100:00100000:0.0:1788463447.764635:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395579904 00000100:00100000:0.0:1788463447.764638:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395579904 00000100:00100000:0.0:1788463447.764651:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395579520 00000100:00100000:0.0:1788463447.764653:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395579520 00000100:00100000:0.0:1788463447.764663:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395579776 00000100:00100000:0.0:1788463447.764665:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395579776 00000100:00100000:0.0:1788463447.764676:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:0.0:1788463447.764713:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2354:x1875339395579392:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463447.764739:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2354:x1875339395579392:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 57us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463447.764745:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:0.0:1788463447.764755:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:0.0:1788463447.764760:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05684b1-3635-43d8-b3a2-83c073790679+5:2354:x1875339395579904:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463447.764775:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05684b1-3635-43d8-b3a2-83c073790679+5:2354:x1875339395579904:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 16us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463447.764780:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:0.0:1788463447.764787:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:0.0:1788463447.764791:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2354:x1875339395579520:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463447.764806:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2354:x1875339395579520:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 15us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463447.764811:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:0.0:1788463447.764818:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:0.0:1788463447.764823:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05684b1-3635-43d8-b3a2-83c073790679+5:2354:x1875339395579776:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463447.764836:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05684b1-3635-43d8-b3a2-83c073790679+5:2354:x1875339395579776:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 14us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463447.764847:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00080000:0.0:1788463447.764864:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463447.764868:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463447.764870:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463448.102617:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408157568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463448.102734:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463448.103063:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408157568 00000100:00100000:2.0:1788463448.103074:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408157568 00000100:00100000:2.0:1788463448.103132:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463448.103143:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408157568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788463448.103196:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788463448.103261:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408157568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463448.103279:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788463448.103344:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408157568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788463448.298274:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463449.322909:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463450.340951:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788463450.998402:0:16497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc42848e90 20000000:00000080:0.0:1788463450.998422:0:16497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ba4c71c0c00 uarg=0000000000000000 20000000:01000000:0.0:1788463450.998469:0:16497:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788463450.998475:0:16497:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788463450.998480:0:16497:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788463451.003153:0:16498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788463451.003316:0:16497:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788463451.021834:0:16497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788463451.021872:0:16497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.021892:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5f7d39600/0xc3fe72277ee36a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36a91 expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.021900:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee36ae5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36ade expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.021907:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36c19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36c12 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.021917:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c47ad800/0xc3fe72277ee36d3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e19c expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.021924:0:16497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ba5c47ac600/0xc3fe72277ee36d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1fe expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.021931:0:16497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.021973:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c47ac600/0xc3fe72277ee36d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1fe expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.023672:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba5c47ac600/0xc3fe72277ee36d77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1fe expref: 12 pid: 14362 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463451.023708:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5617800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875339408157696:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463451.024115:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5c47ad800/0xc3fe72277ee36d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e19c expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.024125:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba5c47ad800/0xc3fe72277ee36d3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e19c expref: 12 pid: 14361 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.024135:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875339408157824:192.168.204.11@tcp:104: 00010000:00010000:3.0:1788463451.024169:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36c19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee36c12 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.024177:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36c19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee36c12 expref: 18 pid: 14362 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.024201:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875339408157952:0@lo:104: 00000100:00100000:3.0:1788463451.024242:0:16497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463451.024287:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee36ae5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee36ade expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.024295:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee36ae5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee36ade expref: 18 pid: 14361 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.024303:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875339408158080:0@lo:104: 00000100:00100000:3.0:1788463451.024322:0:16497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788463451.024343:0:16497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ba5f7d39600/0xc3fe72277ee36a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3fe72277ee36a91 expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463451.024351:0:16497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ba5f7d39600/0xc3fe72277ee36a98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3fe72277ee36a91 expref: 18 pid: 14363 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.024359:0:16497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5edc70700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875339408158208:0@lo:104: 00000100:00100000:3.0:1788463451.024379:0:16497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463451.024389:0:16497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463451.024589:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788463451.024602:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408157952 00000100:00100000:0.0:1788463451.024609:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408157952 00000100:00100000:0.0:1788463451.024661:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408158080 00000100:00100000:0.0:1788463451.024664:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408158080 00000100:00100000:0.0:1788463451.024675:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408158208 00000100:00100000:0.0:1788463451.024677:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408158208 00000100:00100000:0.0:1788463451.024722:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463451.024731:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b647fa9f-8776-4850-826f-89ba9b699661+5:16497:x1875339408157952:12345-0@lo:104: 00010000:00010000:0.0:1788463451.024745:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.024801:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788463451.024807:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b647fa9f-8776-4850-826f-89ba9b699661+5:16497:x1875339408157952:12345-0@lo:104: Request processed in 79us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.024815:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463451.024840:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463451.024846:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b647fa9f-8776-4850-826f-89ba9b699661+4:16497:x1875339408158080:12345-0@lo:104: 00010000:00010000:0.0:1788463451.024854:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.024890:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788463451.024895:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b647fa9f-8776-4850-826f-89ba9b699661+4:16497:x1875339408158080:12345-0@lo:104: Request processed in 49us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.024900:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463451.024911:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463451.024916:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fedf2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b647fa9f-8776-4850-826f-89ba9b699661+3:16497:x1875339408158208:12345-0@lo:104: 00010000:00010000:0.0:1788463451.024923:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.024951:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788463451.024955:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fedf2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b647fa9f-8776-4850-826f-89ba9b699661+3:16497:x1875339408158208:12345-0@lo:104: Request processed in 39us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.024960:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788463451.025021:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788463451.025028:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025035:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38c00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1788463451.025040:0:15442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025051:0:15442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463451.025072:0:15442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463451.025080:0:15442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463451.025118:0:15442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025125:0:15442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463451.025151:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025160:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36c12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36c19 expref: -99 pid: 15776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025181:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788463451.025184:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025191:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39a00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1788463451.025194:0:15442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025200:0:15442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463451.025207:0:15442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463451.025211:0:15442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463451.025229:0:15442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025235:0:15442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463451.025250:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025257:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d39a00/0xc3fe72277ee36ade lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36ae5 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025265:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788463451.025268:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025274:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1788463451.025277:0:15442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025283:0:15442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788463451.025289:0:15442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788463451.025294:0:15442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788463451.025302:0:15442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025307:0:15442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788463451.025311:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025326:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38800/0xc3fe72277ee36a91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3fe72277ee36a98 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025339:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463451.025340:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463451.025342:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463451.025348:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788463451.025353:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463451.025371:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b647fa9f-8776-4850-826f-89ba9b699661:3277:1875339408158336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463451.025403:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463451.025437:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b647fa9f-8776-4850-826f-89ba9b699661:3278:1875339408158464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463451.025456:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463451.025471:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463451.025475:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b647fa9f-8776-4850-826f-89ba9b699661:3278:1875339408158592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463451.025494:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463451.025527:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408158336 00000100:00100000:0.0:1788463451.025532:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408158336 00010000:00010000:0.0:1788463451.025551:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36c19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36c12 expref: 19 pid: 14362 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463451.025569:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408158464 00000100:00100000:0.0:1788463451.025571:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408158464 00010000:00010000:0.0:1788463451.025581:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee36ae5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36ade expref: 20 pid: 14361 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463451.025589:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408158592 00000100:00100000:0.0:1788463451.025592:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408158592 00010000:00010000:0.0:1788463451.025603:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5f7d39600/0xc3fe72277ee36a98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36a91 expref: 21 pid: 14363 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463451.025625:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463451.025631:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+21:3277:x1875339408158336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463451.025657:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463451.025664:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36c19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36c12 expref: 21 pid: 14362 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025676:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36c19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee36c12 expref: 21 pid: 14362 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025725:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463451.025754:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+21:3277:x1875339408158336:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.025761:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788463451.025774:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463451.025780:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+20:3278:x1875339408158464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463451.025786:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463451.025791:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee36ae5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36ade expref: 20 pid: 14361 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025799:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee36ae5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee36ade expref: 20 pid: 14361 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025807:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463451.025826:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+20:3278:x1875339408158464:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.025831:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788463451.025842:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463451.025853:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f48d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+19:3278:x1875339408158592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788463451.025860:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463451.025865:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5f7d39600/0xc3fe72277ee36a98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3fe72277ee36a91 expref: 19 pid: 14363 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025873:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5f7d39600/0xc3fe72277ee36a98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3fe72277ee36a91 expref: 19 pid: 14363 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.025885:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463451.025906:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f48d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b647fa9f-8776-4850-826f-89ba9b699661+19:3278:x1875339408158592:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.025912:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788463451.025976:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b647fa9f-8776-4850-826f-89ba9b699661:3277:1875339408158336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463451.026005:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b647fa9f-8776-4850-826f-89ba9b699661:3278:1875339408158592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788463451.026012:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b647fa9f-8776-4850-826f-89ba9b699661:3278:1875339408158464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788463451.026126:0:16497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36c19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee36c12 expref: 18 pid: 14362 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.026137:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9adf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875339408157952:0@lo:104: 00010000:00010000:3.0:1788463451.026147:0:16497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba4c56b0c00/0xc3fe72277ee36ae5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee36ade expref: 17 pid: 14361 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.026155:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875339408158080:0@lo:104: 00010000:00010000:3.0:1788463451.026163:0:16497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5f7d39600/0xc3fe72277ee36a98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3fe72277ee36a91 expref: 16 pid: 14363 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463451.026179:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5edc70700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875339408158208:0@lo:104: 00000100:00100000:3.0:1788463451.039367:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5617800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875339408157696:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463451.040412:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463451.040524:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395580032 00000100:00100000:0.0:1788463451.040538:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395580032 00010000:00010000:0.0:1788463451.040591:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c47ac600/0xc3fe72277ee36d77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1fe expref: 13 pid: 14362 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463451.040664:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:0.0:1788463451.040677:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9427fd67-5406-46ba-9ba0-54796a705559+13:2355:x1875339395580032:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463451.040739:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463451.040747:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c47ac600/0xc3fe72277ee36d77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1fe expref: 13 pid: 14362 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.040763:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c47ac600/0xc3fe72277ee36d77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1fe expref: 13 pid: 14362 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.040814:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c47ac600/0xc3fe72277ee36d77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1fe expref: 13 pid: 14362 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463451.040839:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463451.040912:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9427fd67-5406-46ba-9ba0-54796a705559+12:2355:x1875339395580032:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 237us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463451.040921:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1788463451.043121:0:16497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16497:1875339408157824:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463451.043170:0:16497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463451.047106:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463451.047226:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395580160 00000100:00100000:2.0:1788463451.047243:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395580160 00010000:00010000:2.0:1788463451.047296:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ba5c47ad800/0xc3fe72277ee36d3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e19c expref: 12 pid: 14361 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463451.047344:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:2.0:1788463451.047357:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9427fd67-5406-46ba-9ba0-54796a705559+12:2357:x1875339395580160:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788463451.047374:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463451.047382:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ba5c47ad800/0xc3fe72277ee36d3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e19c expref: 12 pid: 14361 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047397:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ba5c47ad800/0xc3fe72277ee36d3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e19c expref: 12 pid: 14361 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047422:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5c47ad800/0xc3fe72277ee36d3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e19c expref: 12 pid: 14361 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047443:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047454:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047476:0:14355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047516:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047524:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047532:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047537:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463451.047542:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047552:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047573:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463451.047586:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788463451.047666:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9427fd67-5406-46ba-9ba0-54796a705559+11:2357:x1875339395580160:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 310us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463451.047677:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00010000:00010000:1.0:1788463451.048234:0:16497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.048246:0:16497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.048252:0:16497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ba5f7d38000/0xc3fe72277ee36da1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463451.384755:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463452.199058:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408158720:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199131:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463452.199187:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408159232:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199215:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463452.199241:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788463452.199247:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408158848:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199271:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463452.199289:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408159360:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199308:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463452.199336:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408158976:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199371:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463452.199391:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463452.199397:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408159104:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199421:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463452.199450:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408159232 00000100:00100000:0.0:1788463452.199458:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408159232 00000100:00100000:0.0:1788463452.199506:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408159360 00000100:00100000:0.0:1788463452.199520:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408159360 00000100:00100000:0.0:1788463452.199534:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408159104 00000100:00100000:0.0:1788463452.199536:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408159104 00000100:00100000:0.0:1788463452.199548:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463452.199555:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408159232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199603:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408159232:12345-0@lo:400:kworker.0 Request processed in 48us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.199622:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788463452.199639:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463452.199645:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408159360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199674:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875339408159360:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.199679:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788463452.199715:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463452.199722:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408159104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199752:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408159104:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.199758:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788463452.199776:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408158848 00000100:00100000:0.0:1788463452.199779:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408158848 00000100:00100000:0.0:1788463452.199801:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408158976 00000100:00100000:0.0:1788463452.199804:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408158976 00000100:00100000:0.0:1788463452.199819:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788463452.199826:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408158848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199855:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408158848:12345-0@lo:400:kworker.0 Request processed in 30us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.199860:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788463452.199879:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463452.199885:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408158976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199915:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408158976:12345-0@lo:400:kworker.0 Request processed in 30us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.199920:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788463452.199945:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788463452.199949:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463452.199952:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463452.199985:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7385c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408159104:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.199996:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408158976:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.200029:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408158848:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.200039:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3276:1875339408159360:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.200048:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408159232:0@lo:400:kworker.0 00000100:00100000:1.0:1788463452.200194:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408158720 00000100:00100000:1.0:1788463452.200199:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408158720 00000100:00100000:1.0:1788463452.200237:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788463452.200245:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+16:3276:x1875339408158720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463452.200282:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4aea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+16:3276:x1875339408158720:12345-0@lo:400:kworker.0 Request processed in 38us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463452.200289:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788463452.200418:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408158720:0@lo:400:kworker.0 00000100:00100000:0.0:1788463452.202081:0:3279:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788463452.202106:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408159488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788463452.202169:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788463452.204164:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408159488 00000100:00100000:3.0:1788463452.204178:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408159488 00000100:00100000:3.0:1788463452.204244:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788463452.204258:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408159488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788463452.204303:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788463452.204403:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3279:x1875339408159488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.204413:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788463452.204468:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3279:1875339408159488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463452.233558:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463452.233665:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395580288 00000100:00100000:1.0:1788463452.233679:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395580288 00000100:00100000:1.0:1788463452.233800:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 109 00000100:00100000:1.0:1788463452.233828:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+11:13763:x1875339395580288:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463452.233867:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463452.233896:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee36da8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e22f expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.233934:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee36da8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e22f expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.233949:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c1488000/0xc3fe72277ee36da8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e22f expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.233958:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488000, rc 0) 00000100:00100000:1.0:1788463452.234029:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+12:13763:x1875339395580288:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 203us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463452.234035:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 109 00000100:00100000:1.0:1788463452.241547:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463452.244309:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395580416 00000100:00100000:3.0:1788463452.244331:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395580416 00000100:00100000:3.0:1788463452.244422:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 110 00000100:00100000:3.0:1788463452.244435:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+12:13763:x1875339395580416:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788463452.245308:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+12:13763:x1875339395580416:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 871us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.245319:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 110 00000100:00100000:1.0:1788463452.247778:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463452.247878:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395580544 00000100:00100000:2.0:1788463452.247888:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395580544 00000100:00100000:2.0:1788463452.247933:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 111 00000100:00100000:2.0:1788463452.247942:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+12:13763:x1875339395580544:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463452.248168:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+12:13763:x1875339395580544:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 226us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.248183:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 111 00000100:00100000:1.0:1788463452.260196:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463452.267927:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395580672 00000100:00100000:0.0:1788463452.267953:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395580672 00000100:00100000:0.0:1788463452.268982:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 112 00000100:00100000:0.0:1788463452.268997:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+12:13763:x1875339395580672:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463452.269016:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463452.269040:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c47ac200/0xc3fe72277ee36daf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e236 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.269084:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c47ac200/0xc3fe72277ee36daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e236 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.269098:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c47ac200/0xc3fe72277ee36daf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e236 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.269108:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47ac200, rc 0) 00000100:00100000:0.0:1788463452.269190:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+13:13763:x1875339395580672:12345-192.168.204.11@tcp:101:ll_cfg_requeue.0 Request processed in 197us (9006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.269197:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 112 00000100:00100000:3.0:1788463452.279451:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463452.281413:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395580800 00000100:00100000:1.0:1788463452.281427:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395580800 00000100:00100000:1.0:1788463452.281487:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 113 00000100:00100000:1.0:1788463452.281497:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c4ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+13:13763:x1875339395580800:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463452.282369:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c4ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+13:13763:x1875339395580800:12345-192.168.204.11@tcp:501:ll_cfg_requeue.0 Request processed in 860us (2914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463452.282379:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 113 00000100:00100000:0.0:1788463452.295912:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463452.296059:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395580928 00000100:00100000:3.0:1788463452.296072:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395580928 00000100:00100000:3.0:1788463452.296130:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 114 00000100:00100000:3.0:1788463452.296143:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5cab49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+13:13763:x1875339395580928:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463452.296422:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5cab49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9427fd67-5406-46ba-9ba0-54796a705559+13:13763:x1875339395580928:12345-192.168.204.11@tcp:503:ll_cfg_requeue.0 Request processed in 281us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.296431:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 114 10000000:01000000:0.0:1788463452.324814:0:14365:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788463452.324826:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5c35d7800 from 10 10000000:01000000:0.0:1788463452.324833:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788463452.324917:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c47ac800/0xc3fe72277ee36db6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.324933:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5c47ac800/0xc3fe72277ee36db6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.324965:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5c47ac800/0xc3fe72277ee36db6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463452.324999:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408159616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788463452.325107:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463452.325169:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5fa7e6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788463452.325292:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408159616 00000100:00100000:1.0:1788463452.325302:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408159616 00000100:00100000:1.0:1788463452.325377:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788463452.325389:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5cab4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+16:14365:x1875339408159616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788463452.325408:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463452.325427:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee36dbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36db6 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.325455:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee36dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36db6 expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.325470:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba5c1489800/0xc3fe72277ee36dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36db6 expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463452.325479:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489800, rc 0) 00000100:00100000:1.0:1788463452.325525:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5cab4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+17:14365:x1875339408159616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463452.325533:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788463452.325786:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408159616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788463452.325810:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5c47ac800/0xc3fe72277ee36db6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36dbd expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.325820:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5c47ac800/0xc3fe72277ee36db6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36dbd expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463452.325879:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408159744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463452.325904:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463452.325940:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5fa7e6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788463452.326000:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408159744 00000100:00100000:1.0:1788463452.326005:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408159744 00000100:00100000:1.0:1788463452.326035:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788463452.326042:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5cab49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+17:14365:x1875339408159744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463452.326354:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5cab49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+17:14365:x1875339408159744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463452.326362:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788463452.326577:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408159744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463452.326626:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408159872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463452.326669:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463452.326730:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5fa7e6900 going to sleep for 11 seconds 00000100:00100000:3.0:1788463452.327027:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408159872 00000100:00100000:3.0:1788463452.327034:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408159872 00000100:00100000:3.0:1788463452.327083:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788463452.327096:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+17:14365:x1875339408159872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788463452.327358:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5d44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+17:14365:x1875339408159872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.327367:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788463452.331825:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408159872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788463452.334900:0:16529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788463452.335142:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788463452.335168:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463452.335181:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5c47ac800/0xc3fe72277ee36db6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36dbd expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.335193:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5c47ac800/0xc3fe72277ee36db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36dbd expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463452.335204:0:14365:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463452.335206:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5caabb000 from 10 10000000:01000000:2.0:1788463452.335209:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463452.335249:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36dc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.335258:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36dc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.335270:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36dc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463452.335295:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463452.335376:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463452.335427:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463452.335884:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408160000 00000100:00100000:3.0:1788463452.335893:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408160000 00000100:00100000:3.0:1788463452.335952:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788463452.335970:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+17:14365:x1875339408160000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463452.335984:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463452.335997:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b0e00/0xc3fe72277ee36dcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36dc4 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.336021:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b0e00/0xc3fe72277ee36dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36dc4 expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.336033:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b0e00/0xc3fe72277ee36dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36dc4 expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.336042:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0e00, rc 0) 00000100:00100000:3.0:1788463452.336099:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+18:14365:x1875339408160000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.336126:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788463452.336221:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463452.336236:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36dc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36dcb expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.336252:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36dc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36dcb expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463452.336308:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463452.336336:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463452.336365:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f493c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463452.336419:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408160128 00000100:00100000:0.0:1788463452.336424:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408160128 00000100:00100000:0.0:1788463452.336458:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788463452.336466:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5d44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+18:14365:x1875339408160128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788463452.336784:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5d44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+18:14365:x1875339408160128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.336793:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788463452.336878:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463452.336907:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463452.336945:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463452.336975:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f493c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788463452.337270:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408160256 00000100:00100000:0.0:1788463452.337276:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408160256 00000100:00100000:0.0:1788463452.337303:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788463452.337311:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e15cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+18:14365:x1875339408160256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788463452.337493:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e15cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+18:14365:x1875339408160256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.337510:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788463452.337632:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788463452.339854:0:16530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788463452.340292:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788463452.340319:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788463452.340332:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36dc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36dcb expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.340347:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38c00/0xc3fe72277ee36dc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36dcb expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788463452.340358:0:14365:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788463452.340361:0:14365:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ba5ebded800 from 10 10000000:01000000:2.0:1788463452.340364:0:14365:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788463452.340410:0:14365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38600/0xc3fe72277ee36dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.340418:0:14365:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38600/0xc3fe72277ee36dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.340448:0:14365:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38600/0xc3fe72277ee36dd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463452.340475:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788463452.340548:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463452.340598:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788463452.340737:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408160384 00000100:00100000:3.0:1788463452.340746:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408160384 00000100:00100000:3.0:1788463452.340872:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788463452.340884:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe4c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+18:14365:x1875339408160384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788463452.340899:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463452.340923:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36dd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3fe72277ee36dd2 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.340947:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3fe72277ee36dd2 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.340966:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ba4c56b1400/0xc3fe72277ee36dd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3fe72277ee36dd2 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463452.340976:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1400, rc 0) 00000100:00100000:3.0:1788463452.341022:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe4c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b647fa9f-8776-4850-826f-89ba9b699661+19:14365:x1875339408160384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.341029:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788463452.341102:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788463452.341117:0:14365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38600/0xc3fe72277ee36dd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36dd9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.341126:0:14365:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38600/0xc3fe72277ee36dd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3fe72277ee36dd9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463452.341176:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463452.341201:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463452.341677:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463452.341758:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408160512 00000100:00100000:1.0:1788463452.341763:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408160512 00000100:00100000:1.0:1788463452.341792:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788463452.341799:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe4c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+19:14365:x1875339408160512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788463452.343236:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe4c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+19:14365:x1875339408160512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1431us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463452.343248:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788463452.343462:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788463452.343514:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788463452.343567:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463452.343619:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f493c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463452.343889:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408160640 00000100:00100000:1.0:1788463452.343896:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408160640 00000100:00100000:1.0:1788463452.343945:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788463452.344071:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe4c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+19:14365:x1875339408160640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788463452.344288:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe4c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b647fa9f-8776-4850-826f-89ba9b699661+19:14365:x1875339408160640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 334us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463452.344295:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788463452.344381:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5615880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b647fa9f-8776-4850-826f-89ba9b699661:14365:1875339408160640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788463452.353863:0:16531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788463452.354545:0:14365:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788463452.354578:0:14365:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788463452.354595:0:14365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38600/0xc3fe72277ee36dd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36dd9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463452.354790:0:14365:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.111@tcp lock: ffff9ba5f7d38600/0xc3fe72277ee36dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3fe72277ee36dd9 expref: -99 pid: 14365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463452.390060:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463452.873091:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463452.873237:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395581056 00000100:00100000:1.0:1788463452.873250:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395581056 00000100:00100000:1.0:1788463452.873327:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 124 00000100:00100000:1.0:1788463452.873341:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe4c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+13:2354:x1875339395581056:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463452.873431:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe4c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9427fd67-5406-46ba-9ba0-54796a705559+13:2354:x1875339395581056:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 92us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463452.873439:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 124 00000100:00100000:0.0:1788463452.877145:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463452.877193:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463452.877221:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463452.877247:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463452.877268:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463452.877289:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463452.877321:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395581440 00000100:00100000:0.0:1788463452.877332:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395581440 00000100:00100000:0.0:1788463452.877385:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395581696 00000100:00100000:0.0:1788463452.877389:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395581696 00000100:00100000:0.0:1788463452.877402:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395581312 00000100:00100000:0.0:1788463452.877404:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395581312 00000100:00100000:0.0:1788463452.877415:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395581824 00000100:00100000:0.0:1788463452.877417:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395581824 00000100:00100000:0.0:1788463452.877434:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:0.0:1788463452.877445:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2355:x1875339395581440:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463452.877513:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2355:x1875339395581440:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 70us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463452.877522:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:0.0:1788463452.877559:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1788463452.877565:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05684b1-3635-43d8-b3a2-83c073790679+5:2355:x1875339395581696:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:0.0:1788463452.877592:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05684b1-3635-43d8-b3a2-83c073790679+5:2355:x1875339395581696:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.877716:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:3.0:1788463452.877727:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2355:x1875339395581312:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463452.877756:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2355:x1875339395581312:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.877763:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:3.0:1788463452.877776:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:3.0:1788463452.877783:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05684b1-3635-43d8-b3a2-83c073790679+5:2355:x1875339395581824:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:3.0:1788463452.877813:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05684b1-3635-43d8-b3a2-83c073790679+5:2355:x1875339395581824:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 31us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463452.877820:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:2.0:1788463452.877906:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395581184 00000100:00100000:2.0:1788463452.877912:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395581184 00000100:00100000:2.0:1788463452.877972:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395581568 00000100:00100000:2.0:1788463452.877976:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395581568 00000100:00100000:2.0:1788463452.878000:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:2.0:1788463452.878007:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2355:x1875339395581184:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463452.878038:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2355:x1875339395581184:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 32us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.878044:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:2.0:1788463452.878057:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:2.0:1788463452.878063:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05684b1-3635-43d8-b3a2-83c073790679+6:2355:x1875339395581568:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463452.878083:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05684b1-3635-43d8-b3a2-83c073790679+6:2355:x1875339395581568:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 20us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463452.878088:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:0.0:1788463452.878749:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00080000:0.0:1788463452.878790:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463452.878797:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788463452.878799:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788463453.029367:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788463453.220912:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463453.220937:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba4c7387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408160768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788463453.221030:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463453.221200:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408160768 00000100:00100000:1.0:1788463453.221210:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408160768 00000100:00100000:1.0:1788463453.221264:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788463453.221275:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408160768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463453.221312:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788463453.221363:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408160768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463453.221370:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788463453.221470:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba4c7387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408160768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788463453.415433:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463454.443061:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463455.360362:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463455.360501:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395581952 00000100:00100000:2.0:1788463455.360515:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395581952 00000100:00100000:2.0:1788463455.360648:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:2.0:1788463455.360661:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:14423:x1875339395581952:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463455.360727:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463455.360750:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36de0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e23d expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.360847:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36de7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.360864:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.360876:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.360888:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36dee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.360894:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.360913:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361266:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36df5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361276:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36df5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361284:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36df5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463455.361309:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788463455.361313:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463455.361351:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36df5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361372:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36de7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361378:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36de7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361385:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36de7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361389:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463455.361394:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36de7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361401:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36de7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361413:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5caa41d00) 00010000:00010000:2.0:1788463455.361416:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463455.361421:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36de7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361427:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36de7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361440:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361445:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36dee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361451:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361461:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463455.361464:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361470:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36dee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361478:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ba5e0495600) 00010000:00010000:2.0:1788463455.361480:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463455.361483:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36dee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361488:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36dee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361523:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36de0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e23d expref: 8 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361537:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39600/0xc3fe72277ee36df5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e23d expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.361544:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ba5e0495800) 00010000:00010000:2.0:1788463455.361546:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788463455.361560:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39600, rc 0) 00000100:00100000:2.0:1788463455.361648:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:14423:x1875339395581952:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 990us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463455.361655:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00080000:0.0:1788463455.361858:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788463455.373795:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463455.374022:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395582208 00000100:00100000:3.0:1788463455.374034:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395582208 00000100:00100000:3.0:1788463455.374103:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:3.0:1788463455.374114:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:14423:x1875339395582208:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463455.374138:0:15790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463455.374164:0:15790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36dfc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e244 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.374243:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e03 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.374258:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.374271:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.374287:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.374294:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.374300:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.374674:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36e11 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.374722:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36e11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.374729:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36e11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463455.374740:0:15790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788463455.375293:0:15790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375303:0:15790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e03 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375310:0:15790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375316:0:15790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463455.375320:0:15790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375330:0:15790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e03 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375344:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ba5e0495800) 00010000:00010000:3.0:1788463455.375347:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463455.375352:0:15790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375359:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375371:0:15790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375383:0:15790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e0a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375389:0:15790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375394:0:15790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463455.375397:0:15790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375403:0:15790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e0a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375411:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ba5d0217600) 00010000:00010000:3.0:1788463455.375414:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463455.375417:0:15790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e0a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.375422:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e0a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.380112:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36dfc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e244 expref: 10 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.380146:0:15790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1600/0xc3fe72277ee36e11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e244 expref: 9 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.380157:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0217000) 00010000:00010000:3.0:1788463455.380160:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463455.380174:0:15790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1600, rc 0) 00000100:00100000:3.0:1788463455.380279:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+9:14423:x1875339395582208:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 6164us (6497us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788463455.380289:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:1.0:1788463455.396445:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463455.396559:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395582336 00000100:00100000:2.0:1788463455.396574:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395582336 00000100:00100000:2.0:1788463455.396731:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:2.0:1788463455.396744:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+9:14423:x1875339395582336:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788463455.396875:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+9:14423:x1875339395582336:12345-192.168.204.11@tcp:59:lhsmtool_posix.0 Request processed in 134us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463455.396883:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00010000:00010000:2.0:1788463455.461164:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788463455.505237:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463455.505342:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395582464 00000100:00100000:1.0:1788463455.505351:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395582464 00000100:00100000:1.0:1788463455.505414:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:1.0:1788463455.505425:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+9:14429:x1875339395582464:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463455.505445:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463455.505471:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e24b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505561:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e26 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505576:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505589:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505603:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505627:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505635:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505911:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e26 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505931:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e26 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505939:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505946:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463455.505951:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e26 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505960:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e26 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505975:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5caa41d00) 00010000:00010000:1.0:1788463455.505979:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463455.505985:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.505992:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.506005:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.506011:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.506016:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.506020:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463455.506029:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.506036:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.506044:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ba5c4c7dd00) 00010000:00010000:1.0:1788463455.506047:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463455.506050:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e2d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.506055:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.506087:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e1f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e24b expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.506098:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5caa41d00) 00010000:00010000:1.0:1788463455.506100:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463455.506103:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e24b expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.506113:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1489e00, rc 0) 00000100:00100000:1.0:1788463455.506190:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+9:14429:x1875339395582464:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 766us (964us total) trans 0 rc 301/301 00000100:00100000:1.0:1788463455.506197:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1788463455.516018:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463455.516162:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395582592 00000100:00100000:3.0:1788463455.516177:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395582592 00000100:00100000:3.0:1788463455.516253:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1788463455.516275:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+9:14429:x1875339395582592:12345-192.168.204.11@tcp:700:lfs.0 00000100:00100000:3.0:1788463455.516396:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+9:14429:x1875339395582592:12345-192.168.204.11@tcp:700:lfs.0 Request processed in 124us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463455.516405:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:0.0:1788463455.523032:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463455.523152:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395582848 00000100:00100000:2.0:1788463455.523167:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395582848 00000100:00100000:2.0:1788463455.523249:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:2.0:1788463455.523270:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5e8592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+9:14429:x1875339395582848:12345-192.168.204.11@tcp:36:lfs.0 00010000:00010000:2.0:1788463455.523357:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788463455.523395:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36d62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e1c6 expref: 9 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.523423:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5caa41d00) 00010000:00010000:2.0:1788463455.523429:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788463455.524131:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.524154:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e228 expref: 5 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.524165:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.524214:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e228 expref: 5 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.524242:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e228 expref: 5 pid: 14369 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463455.524262:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14369:1875339408160896:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463455.528076:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49180 going to sleep for 11 seconds 00000100:00100000:0.0:1788463455.544327:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463455.544481:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14369:1875339408160896:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463455.544526:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463455.544773:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395582976 00000100:00100000:3.0:1788463455.544783:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395582976 00010000:00010000:3.0:1788463455.544844:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e228 expref: 6 pid: 14369 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463455.544927:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:3.0:1788463455.544938:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec22b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05684b1-3635-43d8-b3a2-83c073790679+6:2354:x1875339395582976:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463455.544958:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463455.544967:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e228 expref: 6 pid: 14369 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.544981:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e228 expref: 6 pid: 14369 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.545008:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36d9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e228 expref: 6 pid: 14369 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.545051:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5caa41d00) 00010000:00010000:3.0:1788463455.545056:0:14354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.545067:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.545076:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.545116:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463455.545178:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec22b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05684b1-3635-43d8-b3a2-83c073790679+5:2354:x1875339395582976:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 241us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463455.545185:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00080000:0.0:1788463455.545242:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788463455.545760:0:14369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.545770:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.545814:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.545826:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.545834:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463455.547431:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788463455.547451:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.547462:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.547469:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.547475:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463455.547480:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.547488:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.547504:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5caa41d00) 00010000:00010000:1.0:1788463455.547507:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463455.547512:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.547529:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36e34 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463455.547568:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea3eaec7 reply state 00000000954a9b92 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463455.547580:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463455.547740:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5e8592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+10:14429:x1875339395582848:12345-192.168.204.11@tcp:36:lfs.0 Request processed in 24423us (24662us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788463455.547750:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00010000:00010000:0.0:1788463455.556401:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.556419:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.556426:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.556432:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463455.556438:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.556445:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.556478:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ba5c4c7dd00) 00010000:00010000:0.0:1788463455.556481:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463455.556486:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.556493:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e3b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463455.672173:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463455.672429:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395583104 00000100:00100000:1.0:1788463455.672441:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395583104 00000100:00100000:1.0:1788463455.672513:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:1.0:1788463455.672524:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+9:14437:x1875339395583104:12345-192.168.204.11@tcp:101:lctl.0 00010000:00010000:1.0:1788463455.672569:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463455.672599:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e252 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.672709:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.672726:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.672737:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463455.672776:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788463455.672780:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463455.672837:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.672861:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e252 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.672880:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488e00/0xc3fe72277ee36e49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e252 expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.672888:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c4c7d900) 00010000:00010000:1.0:1788463455.672891:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463455.672905:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488e00, rc 0) 00000100:00100000:1.0:1788463455.672981:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+10:14437:x1875339395583104:12345-192.168.204.11@tcp:101:lctl.0 Request processed in 459us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463455.672989:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 20 00000100:00100000:1.0:1788463455.704882:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463455.705124:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395583232 00000100:00100000:3.0:1788463455.705137:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395583232 00000100:00100000:3.0:1788463455.705217:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:3.0:1788463455.705231:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05684b1-3635-43d8-b3a2-83c073790679+5:14438:x1875339395583232:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463455.705263:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463455.705291:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36e50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e259 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.705369:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.705385:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.705398:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463455.705460:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788463455.705464:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463455.705489:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.705516:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36e50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e259 expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.705538:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0200/0xc3fe72277ee36e57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e259 expref: 6 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.705562:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c4c7d900) 00010000:00010000:3.0:1788463455.705565:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463455.705570:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0200, rc 0) 00000100:00100000:3.0:1788463455.705648:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05684b1-3635-43d8-b3a2-83c073790679+6:14438:x1875339395583232:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 420us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463455.705655:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 21 00000100:00100000:0.0:1788463455.708240:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463455.708333:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395583360 00000100:00100000:1.0:1788463455.708343:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395583360 00000100:00100000:1.0:1788463455.708414:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:1.0:1788463455.708427:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05684b1-3635-43d8-b3a2-83c073790679+6:14438:x1875339395583360:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:1.0:1788463455.708450:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463455.708471:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e260 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708532:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708559:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708592:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708607:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708615:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708622:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708760:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36e73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708769:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36e73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708777:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36e73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463455.708811:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788463455.708815:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463455.708833:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36e73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708846:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708852:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708869:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708875:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488200 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463455.708880:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.708888:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709038:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c4c7d900) 00010000:00010000:1.0:1788463455.709042:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463455.709048:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709055:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488200/0xc3fe72277ee36e65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709070:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709076:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709081:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709087:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463455.709089:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709105:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709114:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ba5c4c7da00) 00010000:00010000:1.0:1788463455.709116:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463455.709119:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709125:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36e6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709160:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e260 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709173:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36e73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e260 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.709180:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ba5c4c7d300) 00010000:00010000:1.0:1788463455.709183:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788463455.709185:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488a00, rc 0) 00000100:00100000:1.0:1788463455.709261:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05684b1-3635-43d8-b3a2-83c073790679+7:14438:x1875339395583360:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 837us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463455.709269:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 22 00000100:00100000:0.0:1788463455.731435:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463455.732159:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395583616 00000100:00100000:3.0:1788463455.732173:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395583616 00000100:00100000:3.0:1788463455.732259:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:3.0:1788463455.732270:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05684b1-3635-43d8-b3a2-83c073790679+7:14438:x1875339395583616:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463455.732300:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463455.732337:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e267 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463455.732466:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788463455.732635:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36e7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e267 expref: 9 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.732671:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c4c7d900) 00010000:00010000:3.0:1788463455.732674:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463455.732723:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e267 expref: 9 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.732739:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0c00, rc 0) 00000100:00100000:3.0:1788463455.732802:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05684b1-3635-43d8-b3a2-83c073790679+8:14438:x1875339395583616:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 534us (1379us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788463455.732810:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:0.0:1788463455.740259:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463455.740359:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395583872 00000100:00100000:1.0:1788463455.740370:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395583872 00000100:00100000:1.0:1788463455.740435:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:1.0:1788463455.740446:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05684b1-3635-43d8-b3a2-83c073790679+8:14438:x1875339395583872:12345-192.168.204.11@tcp:36:lfs.0 00010000:00010000:1.0:1788463455.740537:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463455.740578:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36e73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e260 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.740598:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ba5c4c7d300) 00010000:00010000:1.0:1788463455.740610:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463455.740634:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.740648:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.740657:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463455.741254:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009398561d reply state 000000003cdc7c72 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463455.741265:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788463455.741273:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788463455.741369:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05684b1-3635-43d8-b3a2-83c073790679+9:14438:x1875339395583872:12345-192.168.204.11@tcp:36:lfs.0 Request processed in 924us (1120us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788463455.741376:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00010000:00010000:1.0:1788463455.743328:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.743349:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.743359:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.743365:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463455.743370:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.743379:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.743417:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ba5c4c7da00) 00010000:00010000:1.0:1788463455.743420:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788463455.743426:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.743433:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488400/0xc3fe72277ee36e88 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463455.743608:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463455.743712:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395584128 00000100:00100000:3.0:1788463455.743722:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395584128 00000100:00100000:3.0:1788463455.743773:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:3.0:1788463455.743783:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05684b1-3635-43d8-b3a2-83c073790679+8:14438:x1875339395584128:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:3.0:1788463455.744045:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05684b1-3635-43d8-b3a2-83c073790679+9:14438:x1875339395584128:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 262us (440us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788463455.744053:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:0.0:1788463455.749306:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463455.749400:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395584384 00000100:00100000:3.0:1788463455.749412:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395584384 00000100:00100000:3.0:1788463455.749482:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:3.0:1788463455.749493:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05684b1-3635-43d8-b3a2-83c073790679+9:14438:x1875339395584384:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463455.749532:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463455.749567:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36e8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e26e expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.749654:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.749734:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.749746:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.749763:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36e9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.749770:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.749776:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463455.749903:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788463455.749997:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750005:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e96 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750012:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750018:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463455.750023:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750031:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750055:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c4c7d900) 00010000:00010000:3.0:1788463455.750059:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463455.750064:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750070:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750083:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750090:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36e9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750096:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750100:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463455.750102:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750107:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36e9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750114:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ba5d0217600) 00010000:00010000:3.0:1788463455.750116:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463455.750119:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36e9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750125:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36e9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750176:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36e8f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e26e expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750186:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c4c7d900) 00010000:00010000:3.0:1788463455.750189:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463455.750192:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36e8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e26e expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.750202:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0c00, rc 0) 00000100:00100000:3.0:1788463455.750261:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05684b1-3635-43d8-b3a2-83c073790679+10:14438:x1875339395584384:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 769us (965us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788463455.750270:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:0.0:1788463455.760153:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463455.760243:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395584512 00000100:00100000:3.0:1788463455.760255:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395584512 00000100:00100000:3.0:1788463455.760319:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:3.0:1788463455.760330:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05684b1-3635-43d8-b3a2-83c073790679+10:14438:x1875339395584512:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463455.760354:0:15790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463455.760377:0:15790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36eab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e275 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.760471:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.760487:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.760498:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463455.760554:0:15790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788463455.760557:0:15790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463455.760578:0:15790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.760604:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36eab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e275 expref: 12 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.760623:0:15790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e275 expref: 11 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463455.760631:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ba5d0217600) 00010000:00010000:3.0:1788463455.760634:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788463455.760637:0:15790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b1e00, rc 0) 00000100:00100000:3.0:1788463455.760924:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05684b1-3635-43d8-b3a2-83c073790679+11:14438:x1875339395584512:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 595us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463455.760932:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 26 00000100:00100000:0.0:1788463455.771019:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463455.771145:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395584640 00000100:00100000:3.0:1788463455.771157:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395584640 00000100:00100000:3.0:1788463455.771276:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:3.0:1788463455.771288:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05684b1-3635-43d8-b3a2-83c073790679+11:14438:x1875339395584640:12345-192.168.204.11@tcp:37:lfs.0 00000100:00100000:3.0:1788463455.774826:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05684b1-3635-43d8-b3a2-83c073790679+11:14438:x1875339395584640:12345-192.168.204.11@tcp:37:lfs.0 Request processed in 3520us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463455.774846:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:1.0:1788463455.777786:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463455.778349:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395584896 00000100:00100000:2.0:1788463455.778363:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395584896 00000100:00100000:2.0:1788463455.778560:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:2.0:1788463455.778575:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f7988850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05684b1-3635-43d8-b3a2-83c073790679+11:14438:x1875339395584896:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:2.0:1788463455.778918:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f7988850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05684b1-3635-43d8-b3a2-83c073790679+12:14438:x1875339395584896:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 346us (1143us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788463455.778926:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:1.0:1788463455.827233:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463455.827328:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395585024 00000100:00100000:3.0:1788463455.827346:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395585024 00000100:00100000:3.0:1788463455.827440:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:3.0:1788463455.827453:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+10:14444:x1875339395585024:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:3.0:1788463455.827484:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463455.827512:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36eb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e27c expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.828787:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36ec0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.828831:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.828848:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.828869:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ec7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.828877:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.828884:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829286:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee36ece lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829296:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee36ece lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829303:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee36ece lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463455.829337:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788463455.829341:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463455.829380:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee36ece lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829394:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829413:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36ec0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829420:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829426:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d38800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463455.829431:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829439:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36ec0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829454:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c4c7d900) 00010000:00010000:2.0:1788463455.829457:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463455.829462:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36ec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829468:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829485:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829491:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829498:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.829503:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463455.829512:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.830104:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.830118:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ba5e0495600) 00010000:00010000:2.0:1788463455.830121:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463455.830124:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ec7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.830131:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ec7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.830177:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36eb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e27c expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.830204:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38000/0xc3fe72277ee36ece lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e27c expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.830212:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ba5d0217600) 00010000:00010000:2.0:1788463455.830214:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788463455.830217:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38000, rc 0) 00000100:00100000:2.0:1788463455.830298:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+11:14444:x1875339395585024:12345-192.168.204.11@tcp:101:bash.0 Request processed in 2845us (3075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463455.830307:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 27 00000100:00100000:1.0:1788463455.834628:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463455.834853:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395585280 00000100:00100000:2.0:1788463455.834865:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395585280 00000100:00100000:2.0:1788463455.835128:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 28 00000100:00100000:2.0:1788463455.835140:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+11:14444:x1875339395585280:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:2.0:1788463455.835183:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463455.835222:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36ed5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e283 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.835359:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.835376:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e275 expref: 11 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.835385:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.835427:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e275 expref: 11 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.835442:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e275 expref: 11 pid: 15790 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463455.835456:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1875339408161024:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463455.835584:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c5f49780 going to sleep for 11 seconds 00000100:00100000:1.0:1788463455.839486:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463455.839583:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395585408 00000100:00100000:0.0:1788463455.839592:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395585408 00010000:00010000:0.0:1788463455.839632:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e275 expref: 12 pid: 15790 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463455.839701:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:0.0:1788463455.839712:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05684b1-3635-43d8-b3a2-83c073790679+12:2355:x1875339395585408:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463455.839730:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463455.839738:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e275 expref: 12 pid: 15790 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.839772:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e275 expref: 12 pid: 15790 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.839795:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ba5d0217600) 00010000:00010000:0.0:1788463455.839800:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.839810:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.839818:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463455.839839:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463455.839910:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05684b1-3635-43d8-b3a2-83c073790679+12:2355:x1875339395585408:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 199us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463455.839918:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00010000:00010000:2.0:1788463455.841324:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36eb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e275 expref: 11 pid: 15790 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463455.841345:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1875339408161024:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463455.841370:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.841396:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.841402:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.841423:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.841435:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.841446:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842382:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842397:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842408:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463455.842421:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788463455.842459:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842466:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842474:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842489:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463455.842495:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842504:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842518:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ba5d0217600) 00010000:00010000:2.0:1788463455.842522:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463455.842527:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842534:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36edc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788463455.842564:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050d4eb40 reply state 000000009d0825e1 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463455.842574:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788463455.842624:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36ed5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e283 expref: 14 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842640:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e283 expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.842648:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:2.0:1788463455.842651:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788463455.842653:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38800, rc 0) 00000100:00100000:2.0:1788463455.842799:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+14:14444:x1875339395585280:12345-192.168.204.11@tcp:101:bash.0 Request processed in 7660us (8180us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788463455.842815:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 28 00010000:00010000:2.0:1788463455.845142:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.845162:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.845171:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.845177:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463455.845182:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.845204:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.845220:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ba5e0495600) 00010000:00010000:2.0:1788463455.845223:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788463455.845228:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463455.845235:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36ee3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463455.855834:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463455.856396:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395585536 00000100:00100000:1.0:1788463455.856410:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395585536 00000100:00100000:1.0:1788463455.856484:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:1.0:1788463455.856495:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+13:14444:x1875339395585536:12345-192.168.204.11@tcp:101:bash.0 00010000:00010000:1.0:1788463455.856532:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463455.856575:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36ef8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e28a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.856737:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.856754:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.856766:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463455.856816:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788463455.856821:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788463455.856848:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.856861:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.856889:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488800/0xc3fe72277ee36ef8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e28a expref: 15 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.856922:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e28a expref: 14 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463455.856931:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:1.0:1788463455.856933:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788463455.856937:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488600, rc 0) 00000100:00100000:1.0:1788463455.856999:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+14:14444:x1875339395585536:12345-192.168.204.11@tcp:101:bash.0 Request processed in 506us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463455.857006:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 29 00000100:00100000:1.0:1788463455.860975:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463455.861174:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395585792 00000100:00100000:3.0:1788463455.861187:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395585792 00000100:00100000:3.0:1788463455.861253:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:3.0:1788463455.861265:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+14:14444:x1875339395585792:12345-192.168.204.11@tcp:35:bash.0 00000100:00100000:3.0:1788463455.862117:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+15:14444:x1875339395585792:12345-192.168.204.11@tcp:35:bash.0 Request processed in 851us (1152us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788463455.862126:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:0.0:1788463456.009919:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463456.010136:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395586048 00000100:00100000:3.0:1788463456.010148:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395586048 00000100:00100000:3.0:1788463456.010225:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:3.0:1788463456.010237:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+15:14454:x1875339395586048:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:3.0:1788463456.010276:0:15790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463456.010302:0:15790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e291 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463456.010446:0:15790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788463456.010592:0:15790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f06 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e291 expref: 17 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.010817:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ba5c4c7d900) 00010000:00010000:3.0:1788463456.010832:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788463456.010839:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e291 expref: 17 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.010854:0:15790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0400, rc 0) 00000100:00100000:3.0:1788463456.010917:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+16:14454:x1875339395586048:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 682us (1007us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788463456.010924:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 30 00000100:00100000:1.0:1788463456.014192:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463456.014281:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395586304 00000100:00100000:2.0:1788463456.014292:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395586304 00000100:00100000:2.0:1788463456.014361:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:2.0:1788463456.014371:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+16:14454:x1875339395586304:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:2.0:1788463456.014799:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+17:14454:x1875339395586304:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 427us (616us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788463456.014821:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:1.0:1788463456.081118:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463456.081223:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395586560 00000100:00100000:2.0:1788463456.081235:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395586560 00000100:00100000:2.0:1788463456.081316:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:2.0:1788463456.081328:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+17:14457:x1875339395586560:12345-192.168.204.11@tcp:101:lfs.0 00010000:00010000:2.0:1788463456.081363:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463456.081390:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f14 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e298 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.081513:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36f1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.081531:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36f1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.081556:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36f1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463456.081569:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788463456.081793:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f14 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e298 expref: 20 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.081819:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36f1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e298 expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.081831:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:2.0:1788463456.081834:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463456.081839:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39800, rc 0) 00000100:00100000:2.0:1788463456.081964:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+19:14457:x1875339395586560:12345-192.168.204.11@tcp:101:lfs.0 Request processed in 638us (859us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788463456.081974:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 31 00000100:00100000:0.0:1788463456.086464:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463456.086582:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395586688 00000100:00100000:2.0:1788463456.086594:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395586688 00000100:00100000:2.0:1788463456.086673:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:2.0:1788463456.086719:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+19:14457:x1875339395586688:12345-192.168.204.11@tcp:54:lfs.0 00010000:00010000:2.0:1788463456.086803:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f29 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.086822:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.086836:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.086870:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.086877:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f29 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.086895:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.086902:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5f7d39c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463456.086906:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.086913:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f29 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.086944:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:2.0:1788463456.086947:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788463456.086953:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f29 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.086960:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f29 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463456.087048:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+19:14457:x1875339395586688:12345-192.168.204.11@tcp:54:lfs.0 Request processed in 364us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463456.087056:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 32 00000100:00100000:1.0:1788463456.089818:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463456.089936:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395586816 00000100:00100000:3.0:1788463456.089946:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395586816 00000100:00100000:3.0:1788463456.090016:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1788463456.090027:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7386a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+19:2354:x1875339395586816:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463456.090043:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463456.090067:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36f1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e298 expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.090087:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:3.0:1788463456.090093:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463456.090154:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7386a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+18:2354:x1875339395586816:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 129us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463456.090161:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:1.0:1788463456.092822:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463456.092941:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395587072 00000100:00100000:2.0:1788463456.092952:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395587072 00000100:00100000:2.0:1788463456.093011:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:2.0:1788463456.093022:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+18:14457:x1875339395587072:12345-192.168.204.11@tcp:35:lfs.0 00000100:00100000:2.0:1788463456.093520:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+19:14457:x1875339395587072:12345-192.168.204.11@tcp:35:lfs.0 Request processed in 497us (707us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788463456.093528:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000040:00080000:2.0:1788463456.102218:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788463456.456894:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463456.463117:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395587328 00000100:00100000:2.0:1788463456.463143:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395587328 00000100:00100000:2.0:1788463456.463265:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:2.0:1788463456.463277:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba4c7385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+19:14488:x1875339395587328:12345-192.168.204.11@tcp:101:cat.0 00010000:00010000:2.0:1788463456.463313:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463456.463341:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f30 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e29f expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.463515:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.463545:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.463565:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463456.463579:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788463456.470105:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36f30 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e29f expref: 22 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.470134:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e29f expref: 21 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.470162:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:3.0:1788463456.470165:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788463456.470169:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39a00, rc 0) 00000100:00100000:3.0:1788463456.470265:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba4c7385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+21:14488:x1875339395587328:12345-192.168.204.11@tcp:101:cat.0 Request processed in 6989us (13603us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788463456.470274:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 33 00000100:00100000:1.0:1788463456.473595:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463456.473645:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463456.474769:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395587584 00000100:00100000:2.0:1788463456.474791:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395587584 00000100:00100000:2.0:1788463456.474910:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:2.0:1788463456.474928:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+21:14488:x1875339395587584:12345-192.168.204.11@tcp:35:cat.0 00000100:00100000:2.0:1788463456.475337:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+22:14488:x1875339395587584:12345-192.168.204.11@tcp:35:cat.0 Request processed in 414us (1751us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788463456.475349:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 8 00000100:00100000:3.0:1788463456.482146:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395587712 00000100:00100000:3.0:1788463456.482162:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395587712 00000100:00100000:3.0:1788463456.482236:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:3.0:1788463456.482247:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5edc70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+22:2356:x1875339395587712:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463456.482265:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463456.482291:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e29f expref: 22 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.482309:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:3.0:1788463456.482315:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463456.482385:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5edc70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+21:2356:x1875339395587712:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 140us (8739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463456.482394:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00010000:00010000:1.0:1788463456.484956:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788463456.554810:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463456.554928:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395587968 00000100:00100000:2.0:1788463456.554941:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395587968 00000100:00100000:2.0:1788463456.555011:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:2.0:1788463456.555023:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+21:14494:x1875339395587968:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:2.0:1788463456.555049:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463456.555070:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36f45 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e2a6 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.555181:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.555221:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e283 expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.555230:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e28a expref: 22 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.555239:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.555278:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e28a expref: 22 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.555292:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e28a expref: 22 pid: 14369 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463456.555309:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1875339408161152:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463456.555484:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e283 expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.555494:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e283 expref: 22 pid: 14370 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463456.555505:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5614700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1875339408161280:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463456.555545:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528480 going to sleep for 11 seconds 00000100:00100000:2.0:1788463456.561122:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5617b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1875339408161152:192.168.204.11@tcp:104: 00000100:00100000:2.0:1788463456.561143:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5614700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14370:1875339408161280:192.168.204.11@tcp:104: 00010000:00010000:2.0:1788463456.561202:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463456.564967:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463456.565014:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463456.565119:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395588096 00000100:00100000:0.0:1788463456.565132:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395588096 00010000:00010000:0.0:1788463456.565180:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e28a expref: 23 pid: 14369 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463456.565232:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395588224 00000100:00100000:0.0:1788463456.565236:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395588224 00010000:00010000:0.0:1788463456.565249:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e283 expref: 24 pid: 14370 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463456.565287:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:0.0:1788463456.565297:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f48db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+24:2354:x1875339395588096:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463456.565312:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463456.565320:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e28a expref: 24 pid: 14369 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565333:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e28a expref: 24 pid: 14369 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565355:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36eff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e28a expref: 24 pid: 14369 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565371:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:0.0:1788463456.565376:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565384:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565390:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463456.565451:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f48db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+23:2354:x1875339395588096:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 155us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463456.565459:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:0.0:1788463456.565508:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 12 00000100:00100000:0.0:1788463456.565515:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+22:2354:x1875339395588224:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788463456.565546:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463456.565551:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e283 expref: 22 pid: 14370 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565561:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e283 expref: 22 pid: 14370 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565574:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36eea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e283 expref: 22 pid: 14370 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565587:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:0.0:1788463456.565590:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565597:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565605:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.565627:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463456.565646:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+21:2354:x1875339395588224:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 132us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463456.565653:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 12 00010000:00010000:2.0:1788463456.565901:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.565911:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463456.565934:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788463456.566124:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36f45 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2a6 expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.566141:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39a00/0xc3fe72277ee36f4c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2a6 expref: 21 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463456.566148:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:2.0:1788463456.566151:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788463456.566153:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39a00, rc 0) 00000100:00100000:2.0:1788463456.566189:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+21:14494:x1875339395587968:12345-192.168.204.11@tcp:101:dd.0 Request processed in 11168us (11391us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788463456.566196:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:1.0:1788463456.571075:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463456.571205:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395588480 00000100:00100000:3.0:1788463456.571216:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395588480 00000100:00100000:3.0:1788463456.571277:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:3.0:1788463456.571287:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+21:14494:x1875339395588480:12345-192.168.204.11@tcp:36:dd.0 00010000:00010000:3.0:1788463456.571580:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.571619:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.571631:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788463456.571715:0:14368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788463456.571751:0:14368:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a249ed5 reply state 000000009eeecb1a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463456.571760:0:14368:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463456.571845:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+24:14494:x1875339395588480:12345-192.168.204.11@tcp:36:dd.0 Request processed in 558us (781us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788463456.571852:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 35 00000020:00080000:3.0:1788463456.571858:0:14368:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788463456.577394:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463456.577638:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395588608 00000100:00100000:3.0:1788463456.577648:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395588608 00000100:00100000:3.0:1788463456.577747:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 36 00000100:00100000:3.0:1788463456.577758:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+24:14494:x1875339395588608:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:3.0:1788463456.577786:0:15790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463456.577811:0:15790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e2ad expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.577899:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f61 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2ad expref: 25 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.577916:0:15790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f61 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2ad expref: 25 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.577965:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:3.0:1788463456.577968:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463456.577972:0:15790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0600, rc 0) 00000100:00100000:3.0:1788463456.578031:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+25:14494:x1875339395588608:12345-192.168.204.11@tcp:101:dd.0 Request processed in 274us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463456.578037:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 36 00010000:00010000:1.0:1788463456.578216:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463456.578224:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463456.578231:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463456.578237:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463456.578241:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463456.578249:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463456.578261:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:1.0:1788463456.578263:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463456.578267:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463456.578272:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f5a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463456.599071:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463456.599160:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395588864 00000100:00100000:0.0:1788463456.599170:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395588864 00000100:00100000:0.0:1788463456.599239:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:0.0:1788463456.599250:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+24:14494:x1875339395588864:12345-192.168.204.11@tcp:103:dd.0 00010000:00010000:0.0:1788463456.599281:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463456.599308:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f61 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2ad expref: 24 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463456.599329:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:0.0:1788463456.599334:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788463456.599397:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+23:14494:x1875339395588864:12345-192.168.204.11@tcp:103:dd.0 Request processed in 148us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463456.599404:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:0.0:1788463456.601986:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463456.602110:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395588992 00000100:00100000:3.0:1788463456.602120:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395588992 00000100:00100000:3.0:1788463456.602169:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:3.0:1788463456.602179:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+23:14494:x1875339395588992:12345-192.168.204.11@tcp:58:dd.0 00010000:00010000:3.0:1788463456.602275:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.602293:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.602305:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463456.603604:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788463456.603868:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788463456.603953:0:14368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788463456.604229:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+23:14494:x1875339395588992:12345-192.168.204.11@tcp:58:dd.0 Request processed in 2030us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463456.604263:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 37 00000100:00100000:2.0:1788463456.607252:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463456.607336:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395589120 00000100:00100000:3.0:1788463456.607347:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395589120 00000100:00100000:3.0:1788463456.607419:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 38 00000100:00100000:3.0:1788463456.607429:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+23:14494:x1875339395589120:12345-192.168.204.11@tcp:101:dd.0 00010000:00010000:3.0:1788463456.607448:0:15790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463456.607468:0:15790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f6f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e2b4 expref: -99 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.607550:0:15790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.607562:0:15790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f6f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2b4 expref: 24 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.607581:0:15790:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.607594:0:15790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f6f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2b4 expref: 24 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.607607:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:3.0:1788463456.607610:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788463456.607614:0:15790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f6f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2b4 expref: 24 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463456.607622:0:15790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba4c56b0600, rc 0) 00000100:00100000:3.0:1788463456.607763:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+24:14494:x1875339395589120:12345-192.168.204.11@tcp:101:dd.0 Request processed in 335us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463456.607770:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 38 00000040:00080000:2.0:1788463457.125199:0:14402:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788463457.125209:0:14402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788463457.125246:0:14402:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788463457.125253:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788463457.125927:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5616680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14402:1875339408161408:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788463457.126178:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c8528f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788463457.137450:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463457.138733:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395589248 00000100:00100000:1.0:1788463457.138748:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395589248 00000100:00100000:1.0:1788463457.138842:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00080000:0.0:1788463457.138871:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788463457.138883:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+25:14495:x1875339395589248:12345-192.168.204.11@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788463457.138984:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+25:14495:x1875339395589248:12345-192.168.204.11@tcp:900:lhsmtool_posix.0 Request processed in 117us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463457.138993:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1788463457.139206:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5616680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14402:1875339408161408:192.168.204.11@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788463457.154090:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.154180:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395589376 00000100:00100000:3.0:1788463457.154191:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395589376 00000100:00100000:3.0:1788463457.154268:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:3.0:1788463457.154280:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+24:14495:x1875339395589376:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788463457.154359:0:14368:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788463457.154513:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+24:14495:x1875339395589376:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 234us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463457.154938:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 39 00000100:00100000:0.0:1788463457.164641:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.164749:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395589504 00000100:00100000:3.0:1788463457.164761:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395589504 00000100:00100000:3.0:1788463457.164823:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:3.0:1788463457.164833:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+24:14495:x1875339395589504:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788463457.164915:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f76 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.164931:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.164952:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.164966:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36f7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.164973:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36f7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.164980:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36f7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165023:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165031:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165037:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788463457.165075:0:15790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788463457.165078:0:15790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788463457.165090:0:15790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165099:0:15790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165106:0:15790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f76 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165115:0:15790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165122:0:15790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463457.165127:0:15790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165136:0:15790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f76 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165148:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0217000) 00010000:00010000:3.0:1788463457.165155:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463457.165161:0:15790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165168:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee36f76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165182:0:15790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36f7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165188:0:15790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36f7d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165195:0:15790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36f7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165200:0:15790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463457.165202:0:15790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36f7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165208:0:15790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36f7d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165213:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ba5d0217b00) 00010000:00010000:3.0:1788463457.165216:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463457.165218:0:15790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36f7d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165223:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36f7d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165237:0:15790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165246:0:15790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165836:0:15790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165842:0:15790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:3.0:1788463457.165845:0:15790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.165852:0:15790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.166181:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:3.0:1788463457.166185:0:15790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788463457.166190:0:15790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.166197:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36f84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463457.166535:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+24:14495:x1875339395589504:12345-192.168.204.11@tcp:34:lhsmtool_posix.0 Request processed in 1698us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463457.166545:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 40 00000100:00100000:2.0:1788463457.180890:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463457.182376:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395589760 00000100:00100000:1.0:1788463457.182405:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395589760 00000100:00100000:1.0:1788463457.182536:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:1.0:1788463457.182551:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+24:14495:x1875339395589760:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788463457.182590:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788463457.182616:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36f8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e2bb expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.182752:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36f92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.182767:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36f92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.182780:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36f92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788463457.182791:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788463457.182909:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36f92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.182917:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36f92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.182944:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36f92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.182950:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463457.182955:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36f92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.182963:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36f92 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.182976:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:1.0:1788463457.182979:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788463457.182985:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36f92 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.182992:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36f92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.183046:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36f8b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2bb expref: 26 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.183057:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ba5d0217000) 00010000:00010000:1.0:1788463457.183059:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788463457.183063:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488600/0xc3fe72277ee36f8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2bb expref: 26 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.183072:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c1488600, rc 0) 00000100:00100000:1.0:1788463457.183143:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+25:14495:x1875339395589760:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 595us (2267us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788463457.183159:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 41 00000100:00100000:2.0:1788463457.188232:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.188502:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395589888 00000100:00100000:3.0:1788463457.188524:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395589888 00000100:00100000:3.0:1788463457.188724:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:3.0:1788463457.188759:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+25:14495:x1875339395589888:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788463457.188800:0:14370:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788463457.188938:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+25:14495:x1875339395589888:12345-192.168.204.11@tcp:53:lhsmtool_posix.0 Request processed in 204us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463457.188956:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 42 00000100:00100000:0.0:1788463457.199050:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.199478:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395590144 00000100:00100000:3.0:1788463457.199494:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395590144 00000100:00100000:3.0:1788463457.199589:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:3.0:1788463457.199602:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+25:14495:x1875339395590144:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788463457.199631:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788463457.199658:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36fa0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e2c2 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788463457.206972:0:14368:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1788463457.206989:0:14368:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788463457.207065:0:14368:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788463457.207863:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36fa7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.207885:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.207898:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.207969:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1e00/0xc3fe72277ee36fa0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2c2 expref: 28 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.207989:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2c2 expref: 27 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.207998:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495600) 00010000:00010000:2.0:1788463457.208002:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788463457.208006:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d38800, rc 0) 00000100:00100000:2.0:1788463457.208092:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+27:14495:x1875339395590144:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 8492us (9052us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788463457.208102:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 43 00000100:00100000:3.0:1788463457.215135:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463457.216749:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395590400 00000100:00100000:1.0:1788463457.216768:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395590400 00000100:00100000:1.0:1788463457.216860:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:1.0:1788463457.216872:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+27:14495:x1875339395590400:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788463457.216944:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463457.216978:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d38800/0xc3fe72277ee36fa7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2c2 expref: 27 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217006:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495600) 00010000:00010000:1.0:1788463457.217020:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788463457.217058:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36fb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217078:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217091:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217111:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36fbc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3290eab0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217119:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36fbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3290eab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217125:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36fbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3290eab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217246:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36fb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217253:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36fb5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217259:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36fb5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217266:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488a00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463457.217271:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36fb5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.217280:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36fb5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.220216:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ba5d0217600) 00010000:00010000:1.0:1788463457.220222:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463457.220230:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36fb5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.220239:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1488a00/0xc3fe72277ee36fb5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.220274:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36fbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3290eab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.220281:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36fbc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3290eab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.220296:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36fbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3290eab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.220325:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489e00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463457.220329:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36fbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3290eab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.220337:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36fbc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3290eab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.220345:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3290eab0 (ffff9ba5c4c7da00) 00010000:00010000:1.0:1788463457.220347:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463457.220350:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36fbc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3290eab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.220356:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489e00/0xc3fe72277ee36fbc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3290eab0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463457.220570:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+26:14495:x1875339395590400:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 3696us (5444us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788463457.220590:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 44 00000100:00100000:1.0:1788463457.228298:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463457.229732:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395590528 00000100:00100000:2.0:1788463457.229758:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395590528 00000100:00100000:2.0:1788463457.229813:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:2.0:1788463457.229822:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+26:14495:x1875339395590528:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463457.229841:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463457.229864:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36fc3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e2c9 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.229897:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36fca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.229911:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36fca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.229923:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36fca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.230007:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36fc3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2c9 expref: 28 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.230025:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39800/0xc3fe72277ee36fca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2c9 expref: 27 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.230034:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495500) 00010000:00010000:2.0:1788463457.230037:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788463457.230041:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39800, rc 0) 00000100:00100000:2.0:1788463457.230095:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+27:14495:x1875339395590528:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 275us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463457.230102:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 45 00000100:00100000:2.0:1788463457.237601:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.237851:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395590784 00000100:00100000:3.0:1788463457.237873:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395590784 00000100:00100000:3.0:1788463457.237952:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 46 00000100:00100000:3.0:1788463457.237965:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+27:14495:x1875339395590784:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788463457.238105:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.238126:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.238141:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788463457.238615:0:15790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788463457.238627:0:15790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 488848941998ns, next at 489848939312ns, rc = 0 00000004:00010000:3.0:1788463457.239476:0:15790:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4ec3b7c reply state 000000003244e010 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463457.239505:0:15790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788463457.240392:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+29:14495:x1875339395590784:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 2422us (2795us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788463457.240403:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 46 00010000:00010000:2.0:1788463457.245556:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463457.245562:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00010000:00010000:2.0:1788463457.245570:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.245580:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.245585:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0c00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:2.0:1788463457.245591:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.245600:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.245617:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495500) 00010000:00010000:2.0:1788463457.245620:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788463457.245625:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.245632:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0c00/0xc3fe72277ee36fd1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463457.245722:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395590912 00000100:00100000:0.0:1788463457.245732:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395590912 00000100:00100000:0.0:1788463457.245783:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:0.0:1788463457.245793:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+28:14495:x1875339395590912:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463457.245815:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463457.245832:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ac600/0xc3fe72277ee36fd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e2d0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.245896:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ac600/0xc3fe72277ee36fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d0 expref: 29 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.245912:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ac600/0xc3fe72277ee36fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d0 expref: 29 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.245959:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495500) 00010000:00010000:0.0:1788463457.245963:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463457.245965:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47ac600, rc 0) 00000100:00100000:0.0:1788463457.246042:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+29:14495:x1875339395590912:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 251us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463457.246049:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 47 00000100:00100000:1.0:1788463457.252890:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.253031:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395591040 00000100:00100000:3.0:1788463457.253043:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395591040 00000100:00100000:3.0:1788463457.253141:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:3.0:1788463457.253153:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2355:x1875339395591040:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788463457.253530:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463457.258001:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2355:x1875339395591040:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 4834us (5105us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788463457.258018:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1788463457.261967:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463457.262082:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395591296 00000100:00100000:0.0:1788463457.262093:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395591296 00000100:00100000:0.0:1788463457.262153:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:0.0:1788463457.262163:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+29:14495:x1875339395591296:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788463457.262443:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+30:14495:x1875339395591296:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 280us (488us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788463457.262451:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 9 00000100:00100000:3.0:1788463457.270999:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463457.271397:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395591552 00000100:00100000:1.0:1788463457.271409:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395591552 00000100:00100000:1.0:1788463457.271477:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:1.0:1788463457.271488:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+30:14495:x1875339395591552:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788463457.271619:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+30:14495:x1875339395591552:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 132us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463457.271628:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 48 00000100:00100000:1.0:1788463457.275976:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463457.280981:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395591680 00000100:00100000:2.0:1788463457.281000:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395591680 00000100:00100000:2.0:1788463457.281070:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:2.0:1788463457.281080:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+30:14495:x1875339395591680:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788463457.281102:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788463457.281145:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36fdf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e2d7 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.281834:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36fe6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.281856:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.281873:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788463457.281930:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788463457.281954:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.281992:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39200/0xc3fe72277ee36fdf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d7 expref: 32 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.282016:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d7 expref: 31 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.282025:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495500) 00010000:00010000:2.0:1788463457.282029:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788463457.282033:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5f7d39c00, rc 0) 00000100:00100000:2.0:1788463457.282673:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+31:14495:x1875339395591680:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 1589us (6708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463457.282860:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 49 00000100:00100000:2.0:1788463457.286765:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463457.286847:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395591808 00000100:00100000:0.0:1788463457.286859:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395591808 00000100:00100000:0.0:1788463457.286915:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:0.0:1788463457.286926:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+6:2355:x1875339395591808:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463457.286950:0:15056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463457.286981:0:15056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000745b3196/0xc3fe72277ee36fed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e2de expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788463457.287043:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99c961, blocks: 0x1 00010000:00010000:0.0:1788463457.287067:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788463457.287072:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463457.287083:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000745b3196/0xc3fe72277ee36fed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2de expref: 7 pid: 15056 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.287122:0:15056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000745b3196/0xc3fe72277ee36fed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2de expref: 7 pid: 15056 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.287140:0:15056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47ad800, rc 0) 00000100:00100000:0.0:1788463457.287215:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2355:x1875339395591808:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 289us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463457.287223:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:3.0:1788463457.290198:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463457.290399:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395592064 00000100:00100000:2.0:1788463457.290411:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395592064 00000100:00100000:2.0:1788463457.290544:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:2.0:1788463457.290554:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+31:14495:x1875339395592064:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788463457.290672:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+31:14495:x1875339395592064:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 119us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463457.290715:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 50 00000100:00100000:3.0:1788463457.293169:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463457.298813:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395592192 00000100:00100000:1.0:1788463457.298831:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395592192 00000100:00100000:1.0:1788463457.298911:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:1.0:1788463457.298921:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+31:14495:x1875339395592192:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788463457.318774:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408161792:0@lo:400:kworker.0 00000100:00100000:2.0:1788463457.318882:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463457.319084:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788463457.319092:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408161920:0@lo:400:kworker.0 00000100:00100000:2.0:1788463457.319122:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463457.320110:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408161792 00000100:00100000:1.0:1788463457.320121:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408161792 00000100:00100000:1.0:1788463457.320794:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788463457.320808:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408161792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788463457.322442:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408161792:12345-0@lo:400:kworker.0 Request processed in 1628us (3550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463457.322460:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788463457.323198:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408161536:0@lo:400:kworker.0 00000100:00100000:2.0:1788463457.323593:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408162304:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788463457.324013:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788463457.327665:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408161920 00000100:00100000:3.0:1788463457.328225:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408161920 00000100:00100000:2.0:1788463457.328626:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463457.328728:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408161792:0@lo:400:kworker.0 00000100:00100000:2.0:1788463457.328783:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408161664:0@lo:400:kworker.0 00000100:00100000:2.0:1788463457.329084:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463457.329127:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408162176:0@lo:400:kworker.0 00000100:00100000:2.0:1788463457.329159:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463457.329496:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408162304 00000100:00100000:1.0:1788463457.329505:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408162304 00000100:00100000:1.0:1788463457.329598:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788463457.329611:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408162304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788463457.329672:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788463457.330541:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463457.330621:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408161664 00000100:00100000:0.0:1788463457.330629:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408161664 00000100:00100000:0.0:1788463457.330730:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463457.330740:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408161664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463457.330814:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875339408161664:12345-0@lo:400:kworker.0 Request processed in 76us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463457.330822:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788463457.330958:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408162176 00000100:00100000:0.0:1788463457.330965:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408162176 00000100:00100000:0.0:1788463457.331014:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463457.331021:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408162176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463457.331054:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875339408162176:12345-0@lo:400:kworker.0 Request processed in 34us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463457.331060:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788463457.331120:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408161536 00000100:00100000:0.0:1788463457.331125:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408161536 00000100:00100000:0.0:1788463457.331149:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788463457.331156:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec1c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:3276:x1875339408161536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463457.331190:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec1c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b647fa9f-8776-4850-826f-89ba9b699661+19:3276:x1875339408161536:12345-0@lo:400:kworker.0 Request processed in 34us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463457.331197:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788463457.331228:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788463457.331233:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788463457.331268:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3277:1875339408161664:0@lo:400:kworker.0 00000100:00100000:0.0:1788463457.331282:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5617800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3277:1875339408162176:0@lo:400:kworker.0 00000100:00100000:0.0:1788463457.331335:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b647fa9f-8776-4850-826f-89ba9b699661:3276:1875339408161536:0@lo:400:kworker.0 00000100:00100000:0.0:1788463457.331346:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c5616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408162048:0@lo:400:kworker.0 00000100:00100000:0.0:1788463457.331380:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463457.331402:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408162048 00000100:00100000:0.0:1788463457.331405:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408162048 00000100:00100000:0.0:1788463457.331427:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788463457.331432:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408162048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788463457.331461:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875339408162048:12345-0@lo:400:kworker.0 Request processed in 28us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463457.331477:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788463457.331491:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788463457.331507:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5616300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3276:1875339408162048:0@lo:400:kworker.0 00000100:00100000:1.0:1788463457.331775:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408162304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2167us (3155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463457.331782:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788463457.332129:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788463457.332808:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788463457.332819:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408161920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788463457.332997:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875339408161920:12345-0@lo:400:kworker.0 Request processed in 179us (13873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463457.333005:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788463457.333085:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c5616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875339408161920:0@lo:400:kworker.0 00000001:00080000:2.0:1788463457.386215:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1788463457.386243:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1788463457.386269:0:5839:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:2.0:1788463457.386277:0:5839:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788463457.386470:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788463457.386490:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408162432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788463457.386770:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788463457.386868:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408162432 00000100:00100000:2.0:1788463457.386879:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408162432 00000100:00100000:2.0:1788463457.386945:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788463457.386958:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875339408162432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788463457.387192:0:15438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788463457.387196:0:15438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788463457.387198:0:15438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788463457.387200:0:15438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788463457 -> 1788463457 00002000:00010000:2.0:1788463457.387202:0:15438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788463457.387250:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1875339408162432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 294us (576us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788463457.387258:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788463457.387306:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba5c2e2ea00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788463457.387313:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3278:1875339408162432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788463457.387636:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+14:14495:x1875339395592192:12345-192.168.204.11@tcp:44:lhsmtool_posix.0 Request processed in 88713us (94475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463457.387645:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 51 00000100:00100000:0.0:1788463457.390906:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463457.391038:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395592320 00000100:00100000:2.0:1788463457.391047:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395592320 00000100:00100000:2.0:1788463457.391103:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:2.0:1788463457.391113:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2354:x1875339395592320:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788463457.391229:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2354:x1875339395592320:12345-192.168.204.11@tcp:16:lhsmtool_posix.0 Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463457.391237:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 16 00000100:00100000:2.0:1788463457.393812:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463457.393902:0:15790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395592576 00000100:00100000:0.0:1788463457.393912:0:15790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395592576 00000100:00100000:0.0:1788463457.394032:0:15790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 52 00000100:00100000:0.0:1788463457.394042:0:15790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+14:14495:x1875339395592576:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788463457.394102:0:15790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788463457.394137:0:15790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5f7d39c00/0xc3fe72277ee36fe6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d7 expref: 14 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.394160:0:15790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495500) 00010000:00010000:0.0:1788463457.394165:0:15790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788463457.394202:0:15790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.394217:0:15790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.394227:0:15790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788463457.395041:0:15790:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c91d9d1 reply state 00000000e2f56625 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463457.395065:0:15790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788463457.395210:0:15790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+15:14495:x1875339395592576:12345-192.168.204.11@tcp:36:lhsmtool_posix.0 Request processed in 1165us (1406us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788463457.395219:0:15790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 52 00010000:00010000:1.0:1788463457.399071:0:3263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.399088:0:3263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.399096:0:3263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.399103:0:3263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47adc00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:1.0:1788463457.399108:0:3263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.399116:0:3263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.399134:0:3263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495500) 00010000:00010000:1.0:1788463457.399137:0:3263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788463457.399143:0:3263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.399149:0:3263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47adc00/0xc3fe72277ee36ff4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463457.400052:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463457.400126:0:15438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395592704 00000100:00100000:0.0:1788463457.400136:0:15438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395592704 00000100:00100000:0.0:1788463457.400194:0:15438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:0.0:1788463457.400205:0:15438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:14495:x1875339395592704:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788463457.400223:0:15438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788463457.400244:0:15438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f840e7d2f51e2e5 expref: -99 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.400275:0:15438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000745b3196/0xc3fe72277ee36fed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2de expref: 8 pid: 15056 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.400284:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788463457.400289:0:15438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463457.400295:0:15438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 8 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.400329:0:15438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000745b3196/0xc3fe72277ee36fed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2de expref: 8 pid: 15056 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.400344:0:15438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000745b3196/0xc3fe72277ee36fed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2de expref: 8 pid: 15056 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463457.400358:0:15438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15438:1875339408162560:192.168.204.11@tcp:104: 00000100:00100000:0.0:1788463457.400444:0:15438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c851c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788463457.402848:0:15438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15438:1875339408162560:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463457.402886:0:15438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 8 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.402908:0:15438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ba5c47ac400, rc 0) 00000100:00100000:0.0:1788463457.402960:0:15438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+8:14495:x1875339395592704:12345-192.168.204.11@tcp:101:lhsmtool_posix.0 Request processed in 2758us (2914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463457.402969:0:15438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 17 00000100:00100000:2.0:1788463457.405995:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.406146:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395592832 00000100:00100000:3.0:1788463457.406159:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395592832 00010000:00010000:3.0:1788463457.406209:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000745b3196/0xc3fe72277ee36fed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2de expref: 8 pid: 15056 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463457.406299:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:3.0:1788463457.406310:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+8:2354:x1875339395592832:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463457.406338:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463457.406362:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000745b3196/0xc3fe72277ee36fed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2de expref: 8 pid: 15056 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.406375:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000745b3196/0xc3fe72277ee36fed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2de expref: 8 pid: 15056 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.406400:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000745b3196/0xc3fe72277ee36fed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2de expref: 8 pid: 15056 timeout: 589 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.406417:0:14355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463457.406421:0:14355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463457.406429:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 7 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.406439:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 7 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.406481:0:14355:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 7 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463457.406495:0:14355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14355:1875339408162688:192.168.204.11@tcp:105: 00000100:00100000:3.0:1788463457.406602:0:14355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec42ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788463457.409905:0:14355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14355:1875339408162688:192.168.204.11@tcp:105: 00010000:00010000:3.0:1788463457.409938:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463457.410026:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2354:x1875339395592832:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 3717us (4043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463457.410039:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 13 00000100:00100000:2.0:1788463457.412552:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463457.412652:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395592960 00000100:00100000:0.0:1788463457.412662:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395592960 00000100:00100000:0.0:1788463457.412758:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:0.0:1788463457.412769:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2354:x1875339395592960:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788463457.413190:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788463457.413194:0:15056:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788463457 00002000:00010000:0.0:1788463457.413196:0:15056:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788463456 00002000:00010000:0.0:1788463457.413198:0:15056:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788463457 -> 1788463457 00002000:00010000:0.0:1788463457.413201:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788463457.413271:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+8:2354:x1875339395592960:12345-192.168.204.11@tcp:2:lhsmtool_posix.0 Request processed in 502us (731us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788463457.413279:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 18 00000100:00100000:2.0:1788463457.417154:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463457.417255:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395593088 00000100:00100000:1.0:1788463457.417267:0:15053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395593088 00000100:00100000:1.0:1788463457.417342:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:1.0:1788463457.417351:0:15053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c328f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+8:2355:x1875339395593088:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788463457.417399:0:15053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.417420:0:15053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 8 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.417428:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463457.417433:0:15053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463457.417439:0:15053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.417480:0:15053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 8 pid: 15438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.417495:0:15053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 8 pid: 15438 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463457.417527:0:15053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15053:1875339408162816:192.168.204.11@tcp:104: 00000100:00100000:1.0:1788463457.417630:0:15053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4884cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788463457.424533:0:15053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15053:1875339408162816:192.168.204.11@tcp:104: 00010000:00010000:1.0:1788463457.424566:0:15053:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463457.427066:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463457.427294:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395593216 00000100:00100000:1.0:1788463457.427304:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395593216 00010000:00010000:1.0:1788463457.427346:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 9 pid: 15438 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463457.427393:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 14 00000100:00100000:1.0:1788463457.427405:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+9:2355:x1875339395593216:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788463457.427421:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788463457.427445:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 9 pid: 15438 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.427459:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 9 pid: 15438 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.427484:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ea45c64/0xc3fe72277ee36ffb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2e5 expref: 9 pid: 15438 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.427502:0:14354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463457.427506:0:14354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788463457.427522:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.427533:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.427630:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788463457.427739:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+8:2355:x1875339395593216:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 335us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463457.427747:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 14 00010000:00010000:2.0:1788463457.432376:0:15053:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.432421:0:15053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.432459:0:15053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.432467:0:15053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.432476:0:15053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.432484:0:15053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463457.432488:0:15053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.432497:0:15053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.432523:0:15053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463457.432531:0:15053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000305b7326/0xc3fe72277ee37002 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463457.432641:0:15053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c328f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2355:x1875339395593088:12345-192.168.204.11@tcp:1:lhsmtool_posix.0 Request processed in 15287us (15494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463457.432650:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 19 00000100:00100000:2.0:1788463457.437905:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.438082:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395593472 00000100:00100000:3.0:1788463457.438091:0:14368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395593472 00000100:00100000:3.0:1788463457.438158:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 53 00000100:00100000:3.0:1788463457.438168:0:14368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+14:14495:x1875339395593472:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788463457.438274:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee37009 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.438293:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee37009 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.438305:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee37009 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.438618:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.438630:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ac600/0xc3fe72277ee36fd8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d0 expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.438639:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.438677:0:14368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ac600/0xc3fe72277ee36fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d0 expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.439148:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ac600/0xc3fe72277ee36fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d0 expref: 15 pid: 14370 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463457.439180:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5ec71d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14368:1875339408162944:192.168.204.11@tcp:104: 00000100:00100000:3.0:1788463457.439370:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5ec42ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788463457.449932:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5ec71d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14368:1875339408162944:192.168.204.11@tcp:104: 00010000:00010000:0.0:1788463457.449983:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463457.453005:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.453183:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395593600 00000100:00100000:3.0:1788463457.453197:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395593600 00010000:00010000:3.0:1788463457.453249:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ac600/0xc3fe72277ee36fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d0 expref: 16 pid: 14370 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463457.453293:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 15 00000100:00100000:3.0:1788463457.453304:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+16:2354:x1875339395593600:12345-192.168.204.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788463457.453319:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788463457.453326:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ac600/0xc3fe72277ee36fd8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d0 expref: 16 pid: 14370 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.453340:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ac600/0xc3fe72277ee36fd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d0 expref: 16 pid: 14370 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.453365:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ac600/0xc3fe72277ee36fd8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2d0 expref: 16 pid: 14370 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.453383:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495500) 00010000:00010000:3.0:1788463457.453392:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.453403:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.453432:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.453463:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788463457.453558:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+15:2354:x1875339395593600:12345-192.168.204.11@tcp:103:ldlm_bl.0 Request processed in 254us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788463457.453567:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 15 00010000:00010000:0.0:1788463457.454360:0:14368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.454385:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788463457.455363:0:14368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788463457.455564:0:14368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788463457.455615:0:14368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788463457.455823:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14368:1875339408163072:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788463457.456223:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463457.456257:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c9b583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788463457.456935:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408163072 00000100:00100000:2.0:1788463457.456948:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408163072 00000100:00100000:2.0:1788463457.457021:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788463457.457032:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14368:x1875339408163072:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788463457.457137:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14368:x1875339408163072:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463457.457145:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788463457.457324:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14368:1875339408163072:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788463457.459007:0:14368:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788463457.459128:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14368:1875339408163200:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788463457.459219:0:14368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788463457.459249:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5c851c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788463457.459491:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408163200 00000100:00100000:2.0:1788463457.459500:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408163200 00000100:00100000:2.0:1788463457.459582:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788463457.459594:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14368:x1875339408163200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788463457.459827:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14368:x1875339408163200:12345-0@lo:1000:mdt00_000.0 Request processed in 235us (608us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788463457.459835:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788463457.460146:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14368:1875339408163200:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788463457.460195:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460205:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460213:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460219:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0400 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463457.460224:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460244:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460260:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495500) 00010000:00010000:0.0:1788463457.460263:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463457.460268:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460274:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0400/0xc3fe72277ee37010 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460305:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460311:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460316:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460320:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1800 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463457.460323:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460328:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460334:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:0.0:1788463457.460337:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788463457.460344:0:14368:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f6f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2b4 expref: 18 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460367:0:14368:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f6f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2b4 expref: 18 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460376:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f6f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2b4 expref: 18 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.460407:0:14368:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0600/0xc3fe72277ee36f6f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.11@tcp remote: 0x4f840e7d2f51e2b4 expref: 18 pid: 15790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463457.460421:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5c2e2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14368:1875339408163328:192.168.204.11@tcp:105: 00000100:00100000:0.0:1788463457.460535:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ba5f4ba2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788463457.463722:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5c2e2f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14368:1875339408163328:192.168.204.11@tcp:105: 00010000:00010000:0.0:1788463457.463758:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463771:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b1800/0xc3fe72277ee36f68 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463811:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ace00/0xc3fe72277ee37017 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463826:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ace00/0xc3fe72277ee37017 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463837:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ace00/0xc3fe72277ee37017 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463848:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ace00/0xc3fe72277ee37017 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463880:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ace00/0xc3fe72277ee37017 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463887:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ace00/0xc3fe72277ee37017 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463892:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47ace00 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463457.463896:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ace00/0xc3fe72277ee37017 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463904:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ace00/0xc3fe72277ee37017 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463917:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:0.0:1788463457.463920:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788463457.463925:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ace00/0xc3fe72277ee37017 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463930:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c47ace00/0xc3fe72277ee37017 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463941:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee37009 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463947:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee37009 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463953:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee37009 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463959:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0000 already unused, calling callback (ffffffffc1f894f0) 00010000:00010000:0.0:1788463457.463969:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee37009 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463976:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee37009 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463984:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ba5e0495700) 00010000:00010000:0.0:1788463457.463987:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788463457.463990:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee37009 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.463996:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba4c56b0000/0xc3fe72277ee37009 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463457.464261:0:14368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+18:14495:x1875339395593472:12345-192.168.204.11@tcp:57:lhsmtool_posix.0 Request processed in 26093us (26367us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788463457.464273:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 53 00000020:00080000:0.0:1788463457.464279:0:14368:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788463457.464615:0:14402:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788463457.464620:0:14402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788463457.464650:0:14402:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788463457.464655:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788463457.468261:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463457.470724:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395593728 00000100:00100000:0.0:1788463457.470742:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395593728 00000100:00100000:0.0:1788463457.470826:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:0.0:1788463457.470839:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5f798a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+18:14494:x1875339395593728:12345-192.168.204.11@tcp:49:dd.0 00000100:00100000:0.0:1788463457.471824:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5f798a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+18:14494:x1875339395593728:12345-192.168.204.11@tcp:49:dd.0 Request processed in 980us (3565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788463457.471838:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 10 00000100:00100000:2.0:1788463457.472185:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463457.472913:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395593984 00000100:00100000:1.0:1788463457.472927:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395593984 00000100:00100000:1.0:1788463457.472992:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 11 00000100:00100000:1.0:1788463457.473002:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+18:14495:x1875339395593984:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788463457.473755:0:14372:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788463457.473860:0:14372:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1788463457.473911:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.473933:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.473948:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.473957:0:14372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.473964:0:14372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.473970:0:14372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.473994:0:14372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788463457.474079:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+20:14495:x1875339395593984:12345-192.168.204.11@tcp:35:lhsmtool_posix.0 Request processed in 1077us (1907us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788463457.474088:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 11 00000020:00080000:1.0:1788463457.474092:0:14372:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788463457.474121:0:15442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788463457.474128:0:15442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.474135:0:15442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463457.474139:0:15442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.474148:0:15442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.474161:0:15442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ba5e0495500) 00010000:00010000:1.0:1788463457.474164:0:15442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788463457.474170:0:15442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.474175:0:15442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ba5c1489000/0xc3fe72277ee3701e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14372 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.474187:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463457.474189:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463457.474190:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788463457.509375:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788463457.708991:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463457.709042:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.709413:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395594240 00000100:00100000:3.0:1788463457.709426:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395594240 00000100:00100000:3.0:1788463457.709494:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395594112 00000100:00100000:3.0:1788463457.709498:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395594112 00000100:00100000:3.0:1788463457.709533:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:3.0:1788463457.709544:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+8:2357:x1875339395594240:12345-192.168.204.11@tcp:4:dd.0 00002000:00010000:3.0:1788463457.709602:0:15060:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a99c961, atime: 0x6a99c960, ctime: 0x6a99c961, blocks: 0x1 00010000:00010000:3.0:1788463457.709612:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951f11c/0xc3fe72277ee37025 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.709628:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1788463457.709632:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463457.709638:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c951f11c/0xc3fe72277ee37025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.709653:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c951f11c/0xc3fe72277ee37025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463457.720179:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:0.0:1788463457.720836:0:15059:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788463457.720850:0:15059:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788463457.725232:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395594368 00000100:00100000:0.0:1788463457.725254:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395594368 00000100:00100000:3.0:1788463457.730088:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 1 00000100:00100000:3.0:1788463457.730122:0:16611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+10:2356:x1875339395594112:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:3.0:1788463457.730186:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3702c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.730209:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463457.730216:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463457.730225:0:16611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3702c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.730241:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3702c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463457.856386:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1788463457.856435:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1788463457.856444:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1788463457.856563:0:15060:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1788463457.856569:0:15060:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1788463457.856586:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c951f11c/0xc3fe72277ee37025 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.856612:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c951f11c/0xc3fe72277ee37025 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.856621:0:15060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c951f11c/0xc3fe72277ee37025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.856627:0:15060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b1a00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463457.856633:0:15060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951f11c/0xc3fe72277ee37025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.856642:0:15060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c951f11c/0xc3fe72277ee37025 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.856662:0:15060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c951f11c/0xc3fe72277ee37025 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.856681:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c951f11c/0xc3fe72277ee37025 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463457.856801:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+8:2357:x1875339395594240:12345-192.168.204.11@tcp:4:dd.0 Request processed in 147252us (147814us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788463457.856818:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 0 00000100:00100000:1.0:1788463457.856860:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 2 00000100:00100000:1.0:1788463457.856872:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2356:x1875339395594368:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:1.0:1788463457.856903:0:15060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d832a63d/0xc3fe72277ee37033 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.856922:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463457.856926:0:15060:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463457.856932:0:15060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d832a63d/0xc3fe72277ee37033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463457.856945:0:15060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d832a63d/0xc3fe72277ee37033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.861189:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3702c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.861211:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3702c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.861221:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3702c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.861228:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463457.861233:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3702c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.861257:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3702c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.861279:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3702c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.861287:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3702c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463457.861376:0:16611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5614a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2356:x1875339395594112:12345-192.168.204.11@tcp:4:dd.0 Request processed in 131266us (152328us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788463457.861386:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 1 00002000:00010000:3.0:1788463457.936321:0:15060:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1788463457.936332:0:15060:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788463457.936348:0:15060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d832a63d/0xc3fe72277ee37033 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.936363:0:15060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d832a63d/0xc3fe72277ee37033 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.936372:0:15060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d832a63d/0xc3fe72277ee37033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.936378:0:15060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1489000 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:3.0:1788463457.936384:0:15060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d832a63d/0xc3fe72277ee37033 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.936410:0:15060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d832a63d/0xc3fe72277ee37033 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.936433:0:15060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d832a63d/0xc3fe72277ee37033 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.936442:0:15060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d832a63d/0xc3fe72277ee37033 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788463457.936602:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2356:x1875339395594368:12345-192.168.204.11@tcp:4:dd.0 Request processed in 79729us (216432us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788463457.936613:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 2 00000001:00080000:2.0:1788463457.937247:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000100:00100000:2.0:1788463457.950262:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463457.950304:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463457.950335:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.950417:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395594496 00000100:00100000:3.0:1788463457.950432:0:16611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395594496 00000100:00100000:3.0:1788463457.950543:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395594624 00000100:00100000:3.0:1788463457.950548:0:16611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395594624 00000100:00100000:3.0:1788463457.950564:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395594880 00000100:00100000:3.0:1788463457.950567:0:16611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395594880 00000100:00100000:3.0:1788463457.950588:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:3.0:1788463457.950600:0:16611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c5616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2354:x1875339395594496:12345-192.168.204.11@tcp:4:dd.0 00000100:00100000:0.0:1788463457.950625:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:0.0:1788463457.950656:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2354:x1875339395594624:12345-192.168.204.11@tcp:4:dd.0 00002000:00010000:3.0:1788463457.950668:0:16611:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a99c961, atime: 0x6a99c960, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1788463457.950681:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3703a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.950720:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc9cef94/0xc3fe72277ee37041 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.950741:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=489s v=(0 0) 00010000:00010000:3.0:1788463457.950748:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788463457.950763:0:16611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3703a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788463457.950781:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3703a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.951971:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463457.951979:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463457.951986:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc9cef94/0xc3fe72277ee37041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.952003:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc9cef94/0xc3fe72277ee37041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463457.953450:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:2.0:1788463457.953490:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:3.0:1788463457.953560:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788463457.953560:0:15061:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788463457.953574:0:15061:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788463457.953577:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395594752 00000100:00100000:3.0:1788463457.953589:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395594752 00000100:00100000:3.0:1788463457.953653:0:15060:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788463457.953660:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395595008 00000100:00100000:3.0:1788463457.953663:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395595008 00000100:00100000:0.0:1788463457.954395:0:16614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 5 00000100:00100000:0.0:1788463457.954410:0:16614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+11:2355:x1875339395594880:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:0.0:1788463457.954456:0:16614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3a273f4/0xc3fe72277ee37048 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.954475:0:16614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463457.954479:0:16614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463457.954487:0:16614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3a273f4/0xc3fe72277ee37048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463457.954512:0:16614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3a273f4/0xc3fe72277ee37048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463458.009254:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463458.009291:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463458.009344:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463458.009373:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463458.009394:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463458.009417:0:3271:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.11@tcp (source: 12345-192.168.204.11@tcp) 00000100:00100000:1.0:1788463458.009446:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395595776 00000100:00100000:1.0:1788463458.009459:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395595776 00000100:00100000:1.0:1788463458.009532:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395595392 00000100:00100000:1.0:1788463458.009535:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395595392 00000100:00100000:1.0:1788463458.009550:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395595648 00000100:00100000:1.0:1788463458.009553:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395595648 00000100:00100000:1.0:1788463458.009570:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:1.0:1788463458.009582:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05684b1-3635-43d8-b3a2-83c073790679+5:2354:x1875339395595776:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463458.009659:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05684b1-3635-43d8-b3a2-83c073790679+5:2354:x1875339395595776:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 79us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463458.009679:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 23 00000100:00100000:1.0:1788463458.009739:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:1.0:1788463458.009745:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2354:x1875339395595392:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463458.009774:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+5:2354:x1875339395595392:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 31us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463458.009780:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 24 00000100:00100000:1.0:1788463458.009790:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:1.0:1788463458.009796:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05684b1-3635-43d8-b3a2-83c073790679+5:2354:x1875339395595648:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463458.009816:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05684b1-3635-43d8-b3a2-83c073790679+5:2354:x1875339395595648:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 21us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463458.009821:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 25 00000100:00100000:1.0:1788463458.009842:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395595136 00000100:00100000:1.0:1788463458.009846:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395595136 00000100:00100000:1.0:1788463458.009886:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00100000:1.0:1788463458.009892:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec1c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+13:2354:x1875339395595136:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:1.0:1788463458.009917:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec1c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9427fd67-5406-46ba-9ba0-54796a705559+13:2354:x1875339395595136:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463458.009923:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 126 00000100:00080000:1.0:1788463458.009958:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788463458.009964:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788463458.010862:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395595264 00000100:00100000:2.0:1788463458.010874:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395595264 00000100:00100000:2.0:1788463458.010924:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339395595520 00000100:00100000:2.0:1788463458.010928:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339395595520 00000100:00100000:2.0:1788463458.010963:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:2.0:1788463458.010972:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+20:2354:x1875339395595264:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463458.011038:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+20:2354:x1875339395595264:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 67us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463458.011046:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 34 00000100:00100000:2.0:1788463458.011061:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00100000:2.0:1788463458.011067:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05684b1-3635-43d8-b3a2-83c073790679+6:2354:x1875339395595520:12345-192.168.204.11@tcp:400:kworker.0 00000100:00100000:2.0:1788463458.011094:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5fe9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05684b1-3635-43d8-b3a2-83c073790679+6:2354:x1875339395595520:12345-192.168.204.11@tcp:400:kworker.0 Request processed in 27us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788463458.011099:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 35 00000100:00080000:1.0:1788463458.012485:0:14364:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:0.0:1788463458.034085:0:16611:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:0.0:1788463458.034096:0:16611:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788463457 -> 1788463458 00002000:00010000:0.0:1788463458.034117:0:16611:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788463458 00002000:00010000:0.0:1788463458.034119:0:16611:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1788463458.034140:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3703a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.034160:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3703a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.034171:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3703a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.034180:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba4c56b0800 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463458.034186:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3703a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.034199:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3703a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.034226:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3703a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.034233:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040ac3547/0xc3fe72277ee3703a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463458.034364:0:16611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c5616a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+17:2354:x1875339395594496:12345-192.168.204.11@tcp:4:dd.0 Request processed in 83759us (84109us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788463458.034375:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 3 00000100:00100000:0.0:1788463458.034431:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 6 00000100:00100000:0.0:1788463458.034445:0:16611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+16:2355:x1875339395594752:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:0.0:1788463458.034508:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e806ce87/0xc3fe72277ee3704f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.034525:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463458.034530:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788463458.034539:0:16611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e806ce87/0xc3fe72277ee3704f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.034556:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e806ce87/0xc3fe72277ee3704f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463458.036478:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1788463458.094169:0:16614:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1788463458.094202:0:16614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3a273f4/0xc3fe72277ee37048 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.094218:0:16614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3a273f4/0xc3fe72277ee37048 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.094228:0:16614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3a273f4/0xc3fe72277ee37048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.094236:0:16614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47acc00 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:0.0:1788463458.094241:0:16614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3a273f4/0xc3fe72277ee37048 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.094272:0:16614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3a273f4/0xc3fe72277ee37048 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.094298:0:16614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3a273f4/0xc3fe72277ee37048 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788463458.094306:0:16614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3a273f4/0xc3fe72277ee37048 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788463458.094403:0:16614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+16:2355:x1875339395594880:12345-192.168.204.11@tcp:4:dd.0 Request processed in 139990us (144059us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788463458.094414:0:16614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 5 00010000:00010000:1.0:1788463458.095122:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc9cef94/0xc3fe72277ee37041 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463458.095135:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc9cef94/0xc3fe72277ee37041 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463458.095154:0:15059:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc9cef94/0xc3fe72277ee37041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463458.095160:0:15059:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47ad200 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:1.0:1788463458.095165:0:15059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc9cef94/0xc3fe72277ee37041 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463458.095174:0:15059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc9cef94/0xc3fe72277ee37041 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463458.095190:0:15059:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc9cef94/0xc3fe72277ee37041 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463458.095199:0:15059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc9cef94/0xc3fe72277ee37041 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788463458.095255:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+15:2354:x1875339395594624:12345-192.168.204.11@tcp:4:dd.0 Request processed in 144603us (144948us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788463458.095264:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 4 00000100:00100000:1.0:1788463458.095301:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.11@tcp, seq: 7 00000100:00100000:1.0:1788463458.095314:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5ec486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+14:2355:x1875339395595008:12345-192.168.204.11@tcp:4:dd.0 00010000:00010000:1.0:1788463458.095347:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000061502c2/0xc3fe72277ee37056 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463458.095363:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463458.095376:0:15059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788463458.095384:0:15059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000061502c2/0xc3fe72277ee37056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788463458.095397:0:15059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000061502c2/0xc3fe72277ee37056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788463458.098282:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1788463458.137590:0:16611:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788463458.137601:0:16611:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1788463458.137615:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e806ce87/0xc3fe72277ee3704f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.137641:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e806ce87/0xc3fe72277ee3704f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.137651:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e806ce87/0xc3fe72277ee3704f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.137658:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c47ad600 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463458.137663:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e806ce87/0xc3fe72277ee3704f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.137673:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e806ce87/0xc3fe72277ee3704f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.137718:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e806ce87/0xc3fe72277ee3704f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.137726:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e806ce87/0xc3fe72277ee3704f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463458.137827:0:16611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+11:2355:x1875339395594752:12345-192.168.204.11@tcp:4:dd.0 Request processed in 103382us (184381us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788463458.137841:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 6 00000001:00080000:2.0:1788463458.138135:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1788463458.182114:0:15059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788463458.182147:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000061502c2/0xc3fe72277ee37056 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.182174:0:15059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000061502c2/0xc3fe72277ee37056 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.182183:0:15059:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000061502c2/0xc3fe72277ee37056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.182191:0:15059:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ba5c1488600 already unused, calling callback (ffffffffc157a4f0) 00010000:00010000:2.0:1788463458.182196:0:15059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000061502c2/0xc3fe72277ee37056 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.182207:0:15059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000061502c2/0xc3fe72277ee37056 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.182228:0:15059:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000061502c2/0xc3fe72277ee37056 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788463458.182236:0:15059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000061502c2/0xc3fe72277ee37056 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788463458.182350:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5ec486d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2fe540e5-01dd-4c4d-bd30-a716e1b2c216+7:2355:x1875339395595008:12345-192.168.204.11@tcp:4:dd.0 Request processed in 87035us (228855us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788463458.182361:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.11@tcp, seq: 7 00000001:00080000:0.0:1788463458.182855:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00000100:00100000:0.0:1788463458.341589:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ba5fe9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408163456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788463458.341673:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788463458.342339:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875339408163456 00000100:00100000:1.0:1788463458.342351:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875339408163456 00000100:00100000:1.0:1788463458.342428:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788463458.342441:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba5c2e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408163456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788463458.342471:0:15058:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1788463458.342780:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba5c2e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875339408163456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 341us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788463458.342791:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788463458.344656:0:3276:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788463458.344674:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba5c2e2ea00, transno 8589934595 00000004:00080000:0.0:1788463458.344719:0:3276:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788463458.344779:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ba5fe9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3276:1875339408163456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788463458.534852:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463459.556908:0:15442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788463459.965072:0:16652:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788463460.583476:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788463461.608744:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30075 lines, 30075 kept, 0 dropped, 0 bad.